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ABSTRACT 

Adaptation of computers to instructional use in 
academic settings, the military, and industrial training provided the 
focus for this conference on computer managed instruction (CMI) • Part 
1 of the proceedings contains an orientation to computer managed 
instruction; Part 2 consists of brief descriptions of 23 CMI systems; 
and Part 3 is a summary of the conference evaluation* An article on 
the future role of the computer in basic education is appended* 
(CH) 
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INTRODUCTION 



The idea for a small invitational conference on the 
potential value to the education enterprise of 
Computer-Managed Instruction had its origin in two 
unrelated developments. 

First, the last ten years have seen an increasing 
♦ interest in futurology, an attempt to forecast our 

- society's problems, practices, customs and shortcomings 
by the end of the century (Toffler, 1970, 1974; Bell, 
1973;-Burdin et al. t 1974), Second, educators interested 
in technological applications in schools are painfully 
aware that the tapid adoption of computers for 
instructional use has not lived up to our expectations of 
the 1960-65 period. B$c ause research ahd development 
On computer-based ^dfr^ation is so decentralized, it 
^ seemed\like an appropriate time to a$£ss the current 
\ v ' state ,of the art by assembling a small nufrber of men 
£ : and women who were actually in the ^process of 
j>M^yeloping and refining systems of instruction involving 
^j^omputers in significant roles. We r^cognizd^ that there 
A ' Were threermain divisions of the contemporary R&D 
C\ m % effort and the Planning Committee was organized 
\ - '/around academic applications (including both college 
^ ^nd lower school levels), military applications, and 
"industrial trainingaises. 

i ^ " V In planning the Conference invitation list, we 
deliberately sought out those people^ who had solid 
experience with one or more systematic attempts to 
develop and evaluate a Computer-managed instruction 
system. One-hour presentations about functioning TMI 
systems were requested from nine of the invited 
participants. In choosing the nine different programs for 

N Conference presentation, . the Planning Committee 
attempted to achieve a balanced presentation between 
the three divisions academic, military andjindustrial. 
Balance was also sought in trying to be sur£;that all 
major sections 6f*the country were represented. ; . 

The following pages document the proceedings of 
the Conference and the report is divided into three parts. 
Part I contains. the^Conference Planning Abstract which 
was sent to all participants Several weeks in advance of 
the meeting, held November 6-8, 1974 in Chicago, 
Illinois. In addition, a valuable f>ap*er by Dr. Robert G. 
Scanlon on present trends and future directions was 
included here because of its orientation to likely new 
developments. The Scanlon paper was first presentedsu^ 
a Special Superintendents' Seminar held at the* IBM 
.Center, San Jose, California, July 9,. 1974. We are 
' indebted to the International Business Machine x < 
Corporation and to Dr Scanlon forjpving. us permission 

O 

ERLC 



*tO reprint it here. This paper was distributed to 
Conference participants approximately one week in 
advance. Tha remainder of Part I consists of four short 
talks prepared by ^members of the Plarjyning Committee 
and Dr. Michael W. Alien. These talk>, given in the 
opening session of the Conference, were focused upon 
the special conditions and characteristics of the 
academic, military and industrial milieux which are 
relevant to .the development of CNpsystems. 

Part II consists of brief descriptions of 23 CMI 
operating systems which wert* represented by 
participants at the Conference. Each participant was 
invited to bring and distributetwo typewritten pages of 
information about a CMI system inspiration at his/her 
home institution. These reports have been&d^ed and are 
incorporated into the Proceedings. Because onfcsQf the 
major purposes of the Conference was to facilitate^ 
exchange of up-to-date information among professional 
developers of CMI systems, your editor believes that this 
portion of the proceedings presents the record of the 
Conference's greatest value to the field. 

Part III of these proceedings is a summary of the 
Conference evaluation. We asked five ^uestior^ of the 
participants at the close of the-Cdhference and requested 
responses on a five : po^nt scale to each question. An 
additipnal opportunity ,was provided for participants tQ 
make t a comment about any aspect of the Conference 
which impressed them either positively or negatively. 

We are grateful to Mr -Arthur Melmed and Dr. 
Glenn Ingram of'the National Institute of Education for 
encouraging our effort* and for guidance in planning the 
meeting. Our thank*! to 4he International Business 
Machines Corporation for providing the Conference with 
an attractive meeting ro^m at the Education Center in 
Chicago and for computer v support for several of the 
demonstrations by participants. The Planning 
Committee, composed of Dr. John Bolvin, Dr. Henry T\ 
Lippert and Dr. Harvey Long, was especially diligent in 
meeting the deadlines and peremptory Remands ol 
detailed program planning and execution. Mr. Wally 
Lester of Penn State's Conference staff provided 
invaluable.^ervice in coordinating the several sessions and 
in assisting participants. My graduate assistant, Ms. 
Melissa Berkowitz, handled a thousand details and ran 
dozens of errands. Her efforts are warmly appreciated. 
Finally, our gratitude to the busy men and women 
engaged in educational applications of computers who* 
without remuneration, took the time to come to 
Chicago and exchange information with their colleagues. 
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AN EXAMINATION OF THE SHORT-RANGE POTENTIAL 
OF COMPUTER-MANAGED INSTRUCTION 

Harold E. Mitzel 
The Pennsylvania State University 



" Introduction 

It is evident that computers have not lived up to 
the educational potent^ that was envisioned for them 
about a decade ago (Efcker, 19^1, Carnegie Commission, 
1972; Tickton, 1970, p. 74). This conclusion applies 
particularly t.o tutorial uses of computer hardware and 
to specially constructed computer-based course 
materials. Some possible explanations for the delay in 
the application of computer technology include the 
following overly simplified option*. I) too much capital 
"required* for massive equipment acquisition, 2) lack of 
adaptability of business-oriented hardware to 
instructional functions, 3) an overly decentralized 
educajtiori market, 4) the ' lack of resources for 
developing even minimal amounts of .computer-basfed 
course material, 5) a skeptical, anti-technolog> attitude 
on the part of teachers and other educators, etc. For 
whatever the reasons, computer-assisted* instruction 
(CAI) involving an integral- (not supplementary) and 
interactive use of computers is developing much more 
slowly than was envisioned in the early 1960's. 

^ A somewhat less intensive use of computers than 
in CAI takes place in computer-managed instruction' 
(CMI). By means df a $mall invitational conference, an 
examination of the near-term potential of 
computer-managed instruction will be conducted. Our 
thesis is that in the rush to get large numbers of students 
into an interactive mode, on computer terminals, some of 
the basic pdtentjal of computer-managed instruction for 
contributing to the achievement of instructional goals in 
schools, colleges, industries, postsecondary schools and 
military training centers ma> have been overlooked. Our > 
suspicioa that educational technologists "missed the 
boat" by first going for the exciting and exotic CAI 
applications is not advanced in the spirit of blame or in 
the glorification of hindsight, but in the sense of "taking 
stock" of the present situation* 

It is unlikely that any direct documentary 
evidence exists that can answer the question of where to 
put the. developmental emphasis for computer, 
applications in education during the next five years. An * 
approximate answer, however, could come from the 
process of several good men and women reasoning 
toge titer by pooling their knowledge and experience. 



9 

ERIC 



8 



Ideally, we should be able precisely to define the * 
term computer-managed instruction, even though for 
some humanists it conjures up images of people }>eing * 
manipulated by machines. We take thTposthotuhavCbif 
is information processing, but that the information fretfig^^ 
processed is one step removed from direct instruction. 
CMI offers a, kind of middle ground of computer 
application on a continuum between CAI (tutorial) and 
administrative datg processing. 

It has been three years sirice Baker's review^ qf 
computer-based instruction management appeared in the 
Review of Educational Research (Baker, 1971). Most of 
the problems and inadequacies which he identified are 
still with us. There have been, however, a number of 
additional systems developed and there seems to be a 
resurging interest in CMI applications. We are seeing the 
appearance of «tiew terminals, both plasma and 
cathode-ray tube, which should increase the output 
speed of, computers involved with CMI application?. 
These events argue for a careful re-examination of the 
eajly potential of computer-managed instruction. 

Computer-Managed Instruction. 

The state-of-the-art in computer-managed 
instruction suggests that, there are currently, three levels " 
of application. In Level I the computer is used with 
instructor-input in batch processing mode to tabulate 
and accumulate systematic information about marks, 
attendance, test performance, etc. At this rudimentary 
Support level, the role of the computer i& chiefly one of 
replacing high quality clerical and tabulation services. In 
Level II the computer is still Used with instructor-input 
in batch processing mode to accumulate records of 
student .performance, and to feedback these cumulative 
records tg^both the instructor and the student on a 
scheduled basis. A peripdic prescriptive function, 
however, has been introduced at Level II advising 
students on a differential basis of what (hey need to do 
to rerrtove various deficiencies which have arisen from 
their inSttwtor's evaluation of their performance 6n the 
modules. Examples of Lev,el II CMI include the 
Automated Instructional Management System developed 
at Ngw York Institute of Technology and the 
Instruction Support System now in use on a pilot basis 
in the College of Education at Penn State University. 



Level HI of computer-managed instruction systems is 
characterized by a real time interactive interface 
betweetf^the learner and the ComputerLand by a 
diagnostic-prescriptive logic keyed to the student's 
responses to the material stored in the computer. 
Relatively few examples of these sophisticated CMI 
systems are now operable. 



Purpose 



A three-day invitational conference/workshop 
under the sponsorship of th^ National Institute 6f 
Education on the general theme of Computer-Managed 
Instruction will be held! The conference/workshop will ^ 
be held at th^Executive Hofise, Chicago, Illinois during 
November 6-8, 1974. About 35 experienced researqjb^rs 
and developers from schools, higher education, industry, 
government and military training will attend. In order to ' 
give the conference balance and to keep it from being all 
"telling," several experts from among the participant's 
have been invited to "show"" and/or demonstrate the 
highlights of a currently operating CMI system. It is a 
workshop in the sense that the majority of the 
participant's are themselves actively working with one or . 
more CMI systems. Each person should expect to learn 
something useful from the experience which he can take 
home and apply. To facilitate the demonstration and the l 
workshop component, access will be provided to the 
participants on a large computer facility in downtown 
Chicago. J 

The following list of 10 questions illustrates those 
to which, the conferees will be expefted to address 
themselves during the meeting; 



1. What are the current impediments and 
constraints fo widespread application ofCMI in 
education and training? 

2. Given the current amount of ur&^rutilization of 
installed computing power in education 
institutions, what proportion of these 
institutions could use a CMI application without 
a new central processor acquisition? 

3. What modification to typical existing operating 
systems ■ would need to . be made to 
accommodate CMI, and how. much would these 
modifications cost? 

4. Assuming that an institution or a training 
facility interested in CMI now has no significant 
'compute; hardware investment, what are the 
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str&neths and weaknesses of several 
minicomputers versus one large central 
processor?* 

5. Assuming there are about three distinct levels of 
complexity of CMI systems, which level, at 
curfent computer d costs, offers .the best 
instructional value? What level of conj^lexity 
will likely^offer th^best instructional value in a 
decade from now? 

Which ofour society's social values are likely to 
be enljarfced by widespread application of CMI? 

\i6h prevailing values will be challenged or 
threatened by CMI? 




7. How does a CMI innovator go about shifting a 
, faculty, administration, and student body from 

mass education methods to individualized 
adaptive education where the computer is the 
focal po^nt instead of the teacher? 

8. By what method and at what rate does an 
instructional developer introduce CMJ into an 
educational institution— gradually or all at once? 

9. What are the likely new hardware and software 
developments in computer technology during 
tfie next decade that would significantly impact 
CMI either adversely or positively? 

10. Is there a mandated developmental sequence 
and time-line for technological adoptions in the 
U.S. (sometimes estimated at 30 years), or is it 
possible to make short-cuts in the 
developmental process? 

Steering Committee t 

A Steering Committee composed of the following 
persons has met and planned the program. The 
ommittee will* be responsible for^ editing a 
comprehensive final report. 



Chairman 

Dr. Harold E. Mitzel 

The Pennsylvania State University 

University Park, Pennsylvania 

Academic Representative 
Dr, John Bolvin 
University of Pittsburgh 
Pittsburgh, Pennlflvania * 
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Industry Representative • 

Dr. Harvey Long , . 
IBM Corporation 
Bethesda, Maryland 

Military Representative 

Dr. Henry'Lippert H * 

Academy of Health Sciences * 
U.S. Army 

Ft. Sam Houston, Texas 

V j * 

Attendance 

# 

Attendance at the conference is by invitation 
only. Transportatio n^ an^ per diem expenses including * ' 

lodging will be reimbursed for participants. Usually only 
one representative of an installation can be 

accommodated. * \ * 
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COMPUTER-MANAGED INSTRUCTION: PRESENT TRENDS 
AND FUTURE DIRECTIONS 

Robert G. Scanlon 
Research for Better Schools, Inc. 



Introduction 

In the mid 1950's, while^still in its infancy/ 
computer technology entered the world of education. 
First used primarily as a research and administrative tool , 
on cblleM and university campuses, computers soon set 
off the imaginations of innovative educators who 
foresaw the possibilities of using computers as 
instructional tools. *f hey ] developed and appli^jl 
computer technology to educational problems and 
worked toward a revolution which would win * for 
education its ultimate goal -individualized instruction. 
Clearly, v the~ obvious benefits of the computer in 
indiyidualizing instruction would stimulate rapid and 
radical changes in education, and early predictions saw 
the imminent automation of schools. 

IBut, while a wide range of computer applications 
to education can be listed and dozefrs of demonstration 
projects can be cited, the promises pat forth by early * , 
proponents of computerized education remain largely* - 
unfulfilled in the 1970's.^The instructional use of 
computers has continued to lag far behind their use for 
.administrative and research pyrppses. Most of the ' 
sophisticated instructional systems have not yet 
advanced beyond the experimental stage.Those actually 
implemented have not beeR widely used. 

This relatively limited instructional use oft " 
computers has led to very different and even 
contradictory predictions about the 'future of computers 
in education. On .the one hand, some proponents still % 
foresee an imminent breakthrough in the u&\ of 
computers in education. On the other hand, the critics 
feel the computer revolution in instruction is still for off 
in the future, if ever. 

Present Trends in CMI 

My survey of the present status of computer-based 
instructional management systems is limited to 
applications^ elementary and secondary schools. It wiH 
not, therefore, reflect the current activity in higher 
education, military institutions and in industry , albeit 
that suc<reWul/economically viable applications of CMI 



in other - areas are likely to have positive effects upon 
future applications in the scho^s and for that reason, 
warrant careful watching. * 

This status report is based on information- 
available in the literature and from conversation^ with a 
number of pebple involved -in CMI projects. Obviously, 
we have not identified ^all the operational programs., 
Documentation of operational CMI programs is very 
sparse and some. information is simply not available. 

Local district experimentation with CMI seems to 
be growing, but these programs are, of course, the most 
difficult to identify. There is the added- problem of 
determining just what is included, under the CMI 
umbrella. A few agencies which claim ^in their 
promotfonal literature) to have CMI candidly admit that, 
what .they actually have is a component of a potential 
CMI system. 

We have organized the various activities in CMI 
into three separate . 'categories. Major Instructional 
Systems, Local School Systems, and Related Activities. 

Major " Instructional- Systems. Frank B. Baker 
wrote a state-of-the-art review on the major 
Computer-Based Instructional Management Systems 
about five years ago. "The systems he described are still 
.the major systems in existence* Figure 1 provides recent 
information on five systems designed" for use in 
elementary and secondary schools. 

IMS. Although? a number of systems were 
conceived at about the same time-the late 1960V the 
first to become operational was the Instructional 
Management System developed by Systems. 
Development Corporation for the Southwest' Regional 
Labs. The program was run for 2 X A years in a number of 
school in Los Angeles using curriculum in mathematics 
and reading. However, the system is said to be adaptable 
to any curriculum* which has clear, concrete learning 
objectives. The system provides for frequent testing 
profiling, individual study recommendations, and 
summary reports on all. tests. It is purported to help 
make decisions regarding pacing, grouping, sequencing 
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PLAN. Project PLAN /is a major ungraded, 
computer-managecj individualized learning program 
developed by the American Institutes for Research and 
now'^marketed and monita/ed by the Westinghouse 
Learning Corporation. 'Thfc components of PI£AN 
include behavioral. objectives, teaching-learning units 
(TLLTs), testing procedures involving use* of 
criterion-referenced tests related to the objectives within 
the units and to the lojjg-term educational goals, 
guidance and individual planning and teacher 
development. A central computer in Iowa City, Iowa, is 
used to storer and analyze the information and to send 
reports back to the schools on a daily basis. The system 
utilizes existing instructional materials. Pfesently, PLAN 
is said to involve 45,000 students in grades K-12. Cities 
where schools have been using PLAN include: San J&se 
and San FrancisAo, California; Pittsburgh, Pennsylvania; 

* East Orange and*Ridgewood, New Jersey. 

A recent EPIE evaluation 6i PLAN reported that 
although initial costs* are very high, a school system that 
had ufcen in PLAN over a period 6f several years could 
figure on abo\it $42 per pupil for' all contractual services 
(for the school year 1973-74).' 

\ IGE n . individually Guided Education is a 
comprehensive system of instruction at the elementary 
school ley el. The maj^r components ate. a model for 
instructional programming For the individual student, a 
model for developing measurement tools and evaluation 
procedures, and an organizational-administrative 
exponent called the multi-unit scriool. 

The IGE programming model makes use of 
behayigrfal objectives and criterion-referenced tests. 

* Presently, CMI is not a^art of the IGE system which is 
now operating in mbre than 1,000 schools. However, 
,CMI is being introduced on a trial basis in 8 schools with 
plans to 'expand the trial to 30 schools in the near 
future. The computer-based system will provide test 
scoring, achievement -p^fijlpg, diagnosis, prescription, 
and instruction. " 

IPI/MIS. The IPI Management and Informa^dfi 
System makes use of detailed objectives, methods and 
materials to obtain the objectives, determination of 
individual competence, continuous evaluation and 
student performance monitoring. The computer is being 
used on an experimental Basis in the Oakleaf School to 
collet aiH process information on each student'and to 
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supply summary reports to teachers. This system is 
specifically designed for use with the IPI curricular 
materials. 

AIMS. The Automated Instructional Management 
System developed by the New York Institute of 
Technology is reported to J)e in* use in at feast one school 
system (Mineola Public Schools, Minebla, New York). 
The system is specifically designed to be independent of 
the course or curriculum, subject area or level, so that, 
according to its developers, it can be utilized with any 
course materials designed around behavioral objectives. 
The system utilizes teletype terminals for immediate 
reports on progress* to students, while^eports to 
instructors and curriculum designers are batch processed. 
AIMS includes information, on objectives, students, 
curriculum and facilities, instructional strategies, tests 
and feedback. Its functions include evaluation of student 
progress, prescriptions, and empirical validation and 
optimization of instruction. 

Local School District Activity. There are 
indications that local districts, in some cases, with 
technical assistance of a research group and financial 
support from federal funds, are developing CMI systems 
to meet their own needs and specifications. One example 
of a locally developed system has been developed by 
Katherine Morgan of Montgomery County, Maryland. 

An example of t local CMI ^program is the 
Instructional Management Program (IMP) in the 
Philadelphia Public Schools. This program is designed to 
ensure that each student achieves minimum standards of 
performance in basic skill areas. The program was 
developed in one school ^nd ha^ spread to six other 
schools in the district, involving more than 2,500 
students. Each school se^s its own standards of 
performance on basic objectives. 

► * 
Learning takes place through independent study, 
packets, student tutoring, and professional tutoring. 
Eaich step in the learning process is .prescribed by a 
computer system which matches the available learning 
options to the individual needs and characteristics of the 
student. The ^unique features of this program are its 
concentration on* basic objectives rfRd the attempt, to 
match student \learning styles to the teaching 
clftracteristics of curriciflar ipaterials. 

^ t Other CMI programs are in operation in 
Philadelphia, and in Madison, Wisconsin, Cedar Rapids 
Iowa; and other, schdj^} districts. 



Related Activity. There are a few computer-based 
testing programs which have some instructional 
management features. Three programs of this* type are. 
^ftmprehensive Achievement Monitoring (CAM); 
Student Achievement Monitoring (SAM), and theV. 
Classroom Teacher Support System (CTSS). 

.CAM is a computer application to instruction 
which monitors individual student progress on specific 
behavioral objectives: It is essentially a computer-based 
testing system which includes fire-tests, mini-exams, and 
♦follow-up, data on student retention. The data can also 
be manipulated by the computer to produce program 
evaluation data. CAM is being used in a number of ^ 
schools invthe country and the concept is also 
incorporated in the . Minnesota/Ties system and in a 
program called PREP under development at the General* 
Learning Corporatton. Operational, , programs are 
"reported in schools m Arizona, New Jersey, New York, 
Illinois«and Minnesota. SAM, which is very similar to the 
CAM concept, has been in operation in the, Oakland^ 
School Districtln Michigan for a number of years. 

The Classroom Teacher Support System (CTSS) 
developed by IBjM provides clerical and logistical support 
for the teachsrwho cqntinues tojnake the decisions. 
The teacliec specifies the objectives and the test function 
is accomplished by the program. It is in use in theJLos 
Angeles City Unified SchoohDistrict. 

StJU another 'computer-supported system for 
tracking and guiding student progress is Tractr. Tracer is 
commercially available front Educators Alliance, in Palo 
AJto t I believe that Hewlett-Packard i§ developing a CM I 
system aftoell. \ 1 • 

&b Conclusjons.This brief review of the present status 
f Cwtn schools suggests the following conclusions. 

jfi . There seenfs to be considerable interest in CMI 
at the Ideal school level, A number of small CMI 
systeftis are operational or under development in " 
^individual schools or school districts. This seems" 
to be a direct result of the management problems 
which are encountered as schdols individualize . 
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their educational programs. 

I.f CMI sy stents are still under develbpment in 
many latye scale instructional programs. Despite 
early predictions, JGE and IPI have not yet 
introduced operational CMI systems. The 
developers have tended to concentrate on the 



continuing redesign and redevelopment of the 
instructional program itself rather than building a 
computer management system. This situation 
- should change in the immediate future. 

3. Virtually no data exists on the 
cost-effectiveness of (Ml While I suspect CMl 
, may be a cost-effective technique, I can only 
support my opinion with " some preiirtgjiary 
analysis of IPI done at RBS. We estimate that 
■ most of the cost of adding a .computer 
management system wquld be offset by 
% reductions in the number of aides requited to' do 
the clerical work. Further, we feel we can add 
some features to the program which might make it 
more effective. I simply don't kno^ of any 
literature which might support or refute my 
feelings in this matter. 



Future Directions 



In one of our projects at RBS> we are attempting 
to forecast future deyelopments in educatioiLandjiesign 
educational programs which are leased on these 
developments. Onq, of oiu jnajor inta(Sitsjs the role 
N might play in -schools s in the 



computer technology 
immediate future. 



' . As a point of departure, We have been conducting 
conferences . on educational futures and educational 
technology. Not surprisingly, we are finding that 
educational futurists have different visions of the role of 
the computer in education over the next few years. 
Figure 2 indicates the reasons some people have offered - 
for Or against a 'dramatic increase in computer use in the 
near future. The people predicting. a strong increase 
point to recent develbpments in computer technology, 
including the steadily decreasing cost of computing and 
the continuing increase in the availability *of curricula 
and software materials. More importantly, they view 
trends in education toward more accountability, higher 
levels of individualization, and improved productivity as 
leading to more computer usage. 

Others predict a limited role for the computer, at 
least in the immediate future. These people cite major 
problems with the application of computers to 
education such as the potential for depersonalization of 
the educational process, the limited financial resources 
available for technology, -the resistance to computers 
from traditional teachers and teachers* unions, and -the 
lack of cost/effectiveness data on instructional uses. 



Dramatic Increase 



Limited Role 



Decreasing Cost df Computing 
Increasing Availabim3C jt 5f^Software 
Emphasis on Accountability 
• Movement Toward Individualization 
Need for More Productivity 



Potential for Depersonalization 
Limited Financial Resources for Technology 
Resistance from Traditional Teachers and Unions 
Lack of Data on Cost/Effectiveness in Instruction 



Figure 2. PREDICTIONS ABOUT INCREASED COMPUTER USE IN SCHOOLS 



We arc pre^ritly analyzing this mass of prediction 
and contradiction 10 isolate some common O^es 
which will provide aNtrong foundation for designing 
school programs. In the remaining time, I would like tcT" 
, outline our thinking on designs for schools of the future 
emphasizing the role of computer-managed instruction 
in these designs. 

Our fundamental assumption aEtaut the future of 
Arherican education is that schools in 1980 will be at 
least as diversified as they are now. It is flighty unlikely 



that all schools will ever adopt a single set of educational 
goals, methods, or materials. On the contrary, we expect 
the present movement toward decentralization, local 
autonomy, and alternative schools to result in even more 
^diversified educational programs in schools of the future. 



- However, we also believe that many schools in 
1980 will share some objectives in common. For 
example> we believe the propositions listed in Figure 3 
reflect some of the major needs and problems of schopls 
in the near future-. " . 
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' the Emerging Confrontation. Decreasing school enrollments and increasing educational costs will 
result in a confrontation between educators and taxpayers. ■ . v 

Educational Productivity. Educational costs and instructional effectiveness will become primary 
" considerations. ^ 

Basic Education. There will be increased emphasis on the development of certain basic "skills. 

Mastery Learning. A determined effort will be made to ensure that every student masters the basic 
objectives of education. . 

Quality Education and Desegregation. Integration of the schools will be directly related to 
improving the quality of education for all students. 

Individualization and Personalization. Individualization and personalization of the educational 
process will become accepted practice at least in certain curricula areas. - 

Figure 3. PROPOSITIONS A^OUT SCHOOLS IN 1980 



/ 



Tlte Emerging <bnfrontation. Decreasing schpol 
enrollments and increasihgeducationai cost/will result 
in a confrontation betweenseducators and taxpayers. 
Educators will view decreasiite enfollrilents as an 
cppoiUinity to improve the qualityo{education mainly 
by reducing class, size. Taxpayers wuN^ee decreasing 
, enrollments as aft opportunity to reduce co&sjuimarily 
by cutting staff positions. 



ERIC 



Educational Productivity^ Educational costs and 
instructional effectiveness will be primary considerations 
in all educational programs. Technology, including both 
hardware and software systems* Will be widely used to 
reduce costs While maintaining or even enhancing 
effectiveness. Schools will be held accountable by the 
public for teaching in an efficient and effective manner. 
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^ Basic Education. Tfiere will be increased em 
on the development of certain basic skills in all 
educational programs. A broader definition of the basics 
will be accepted by most schools to include not only the 
traditional cognitive skills in reading, writing and 
arithmetic, but also some affective and career concepts. 
Educators will place more emphasis on affective 
concepts such as teaching conflict resolution and moral 
judgments, as well as career concepts involving exploring 
career* and specialized experience in selected career 
choices. . 0 

Mastery Learning. A determined effort will be 
made to ensure that evefy studeftt masters the basic 
objectives of education. Educators will. recognize that 
every student can learn the basics when provided with a 
program that truly adjusts t^jladividual differences in 
learning. ^ N 

Quality Education and Desegregation. Integration 
of the jschools will be directly related to improving the 
quality of education for/all students. Solutions to the 
desegregation problem w&Sjjce*the form of providing 
bettereducation for students rather than busing to force 
integration. 

Ind ivid ualizatidn and Personalization. 
Individualization and personalization of the educational 
process will become accepted practice at least in certain 
areas of the curriculum. Basic skill education and 
integrated learning situations will be major targetsju* 
individualized learning programs. . 

General Conclusions 

Three general conclusions can be reached on the 
basis *df this review of present trends ariff future 
directions in CML 

n 

L Widespread use of CMI will occui if ^chodls 
individualize instruction using structured curricula 
materials. Developing a computer manageme nt 
systepi is a fairly simple task if the curricula 
materials in use have well-defined behavioral 
objectives, alternative, teaching methods, apd, 
criterion-refejence.d tests. Materials of this typor 
are still npt widely used in schools. A majo/ 
^obstacle to the use of CMI is the lack of published 
curricula materials which are highly structured. 

2.. CMI has suffered from the lack of a nationally 
prohiinent demonstration project. PLATO in 
TICC1T have provided a vehicle for^xperimemin 



with CAI and demonstrating its potential to the 
educational community. On the other hand, ,the 
potential of. CMI ha? not been systematically 
explored in a laree-scafe, federally-funded project. 
w Consequently* the use of the computer as a 
anagement tool has**et*been brought to the 
attenfiDireC^ducators or tfie public at Targe. 

3. Finally, jl wouty like to conclude with a word 
to, our ho£ts. Educational technology is best 
defined as the application of scientific processes 
an4 products to the improvement of education. 
At Us worst, it is considered labor-savjng hardware- 
and electronic gadgeiry. We would all do well to 
remember that it is up to the makers of machines 
to/carry out the tasks we present, it is not dip to us 
to warp our systems hi order to provide work for 
a machine^designed to ojp something else. 

itaost bf the # <&rricula taid materials for these 
programs are already available! A system for focusing, 
integpting,Jand managing, the programs is not available. 
In fajct, thp operation of these programs without a 
compkitsr management system ^almost inconceivable. 

Computer management becomes mandatory when 
a .program' involves large numbers of students, many 
different gtait Tevel^, highly individualized materials, a 
niimber "of subject^ areas, and diverse teaming 
eijivjrfmnifid^ scheduling, and evaluating 

these conditions requires computer 



students under 
assistance. ; 
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! j For Example, in the programs outlined above, data 
would be Collected jat periodic intervals on individual 
student objectives,' aptitudes, and interests. The 
computer \yould use these dab to track student progress 
at each steb in the learning process, to schedule student 
l^arnftg activities on the basis of individual needs, to 
supply clerical assistance and management data to 
tdachers, and to provide evaluative information to 
administrators on the effectiveness of instruction. , 

The particular examples' used here are only two 
designs (or pchools of the future. We ha\Je models for a 
* nimbfer, of other programs. The critical point is, that in ' 
eyery single . design we find a vital need for a 
computer-njanaged instructional system. We believe CMI 
will play a critical fole in.schools of the future. 
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COMPtUgR-MANAGpD INSTRUCTION: THE ACADEMIC SCENE 
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As I'm sure will be stated by others, the 
application of computers to education has failed to live 

' up to their predicted potentials our elementary aj»d 
secondary schools, and in undergraduate colleges. T)f 
course /there are many reasons for this^most of which 
we are all familiar with just by the nature of our 
positions., However, it is the belief of some, and I wish I 
could say many, that the greatest potential for computer 
use in the near future seems to be in the area of 
assistance to the management aspects of the learning 

^process. Directly related to this belief is the more general 
concern fdr individualized;, personalized, or adaptive 
education. Therefore, in order to examine the potential 
uses of the computer we should back up and look at the 
instructional needs of the students and the effects these 
needs have on the institution. To examine the 
insti^ictional heeds of a given student at a given time, 
there are many variables or factors that should be 
considered. Where is he now? Where does he want to go? 
What goals does society say be should have in addition 
to his own goals? What does it take to help him reach 
both his own gpals and society's goals? What is the most 
effective means of helping him obtain these goals? All of 
these questions imply that instruction begins with' the 
individual student and not with*groups. They imply that 
education plans should begin with individual's both long 
and short tefm designs. They imply that the resources to 
be utilized in the instruction program should be geared 
to individual styles, rates, needs, previous experiences, 
and interests of the learner. In short, effective 
instruction means adaptability to the student. 

Individualization of Instruction * 

To date» hearly all of the programs for elementary 
and secondary schools and for undergraduate colleges 
that have attempted to provide for individualization 
have begun by examining tlie instructional needs for a ' 
single subjsert, and then sometimes combining these 
single subjects Into a single system. Individually 
Prescribed Instruction has primarily been concerned - 
with reading, mathematics, science, and spelling^Project 
PLAN (see Tible 1) has emphasized reading, 
mathematics, social studies, language and science, <to 
mention a few at the elementary and secondary* leveU. 
At the undergraduate level tiie subject are^s where 
attempts to adapt havebeen more widespread include: 
mathematics, English or English language, science 
courses and psychology-again single courses. Although 
this approach is not necessarily a poor one, it does 



provide limitations for management MtJcfTthat djirectly 
relate to computer assistance in management. A single 
subject approach generates information 'needs of a 
particular kind that relate to the individual student 
differences and are of concern for instruction. The broad/ 
categories of individual differences that now seem to b^ 
of concern include providing-for: 

1 . differences in entering level of achievement amcpg 
students in a given class, 

2. differences in rate of learning toward certain fixed 
goals for. the course,/ 

3. differences in gross learning styles by ^avijig 
available a limited variety of resources and 
materials, 

4. those individual differences among students that 
relate to student-teacher interaction needs, 

* • i"* 

*5. certain select subject goals for some students and 

not for all, and 

6. a limited degree pf attention to individual 
differences relating to differences in attitude and 
4 motivation of the learner toward learning and 
instructional tasks. 

It should be pointed out here that in addition to 
I the general goal of adaptive or individualized instruction 
I that is serving, as a basis of need for computer-assisted 
\ management, there are several other goal*. One of these 
\jL-tbe goal of mastery or proficiency of ihe subject 
matter. Another is developing Jelf-directed and 
self-initiated learners. And still another goal is to develop 
learners who can begin 40 evaluate their own needs, 
progress, and outcomes. These last several goals relate to 
more concern by educators for the active role of the 
'student ^n the learning process. . 

All^of these factors then relate specifically to the 
general environmental needs or instruction in the 
element^, secondary and ^undergraduate programs at 
this time. These needs can best be described in terms of 
the instructional elements that are of major doncern to 
practitioners; 

V 

£gglz<!?td objectives 
)fpil diagnoses 
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Instructional resources 
Instructional strategies % 
■ Classroom, management / , 

Pupil outcomes 1 t „ 

Pro&am evaluation 

Let me just say a few words about each of these 
components and point out briefly what kinds of 
information we now provide the practitioner, whsrt the 
weaknesses are with this information, What we 'might 
provide them, and in somecasqs, how information mighT^^ 
be provided. / ♦ • 

Goals and Objectives 

At the present time we more often than not 
provide in some document'to teachers and others the 
overriding goals of the institution and its program. These 
goals are usually stated exnee, verbalized by all, and then 
set aside hoping that the instruction system is designed 

* to reach these broader goals. If general goals come up 
again, for the teacher or institution, it is usually at the 
time of evaluation. On the otherhand, particular course 
objectives are usually well developed, quite 
comprehensive, are compiled in several documents and 
repeated either as individual Objectives or groups of 
objectives on materials, tests, forms, etc. By the 
emphasis placed on the documentation of these 
objectives there is no doubt that they are important. In 
addition to providing the statement of objectives, we 
organize them into units, clusters, levels and topics. This t , 
organization helps both students and instructor^ and is a' ' 
real strength to instructional programming. A weakness 
that ( should be poinred out, however, \% that .because 
they get the emphasis they do, often these objectives t 
become ends and not means as intended. To adjust for 
means-end confusion we need to begin establishing^ ^ 
priorities of objectives relative to total outcomes. These \ 
priorities need to be explicit and well documented for | 
classroom use. Through the priorities we need to call 
attention to alternative sequencing, objectives that serve f 
as prerequisites to others and for what reason. Lihink 4 

-Vpat many of us have observed over time is thaj[ sorne of 
the original supporters,of the concept, of individualized - % 
and more syStemized instructional ffrograms have backed 

. away because pf the seerning rigidity that hasi:ome into '* 
the programs? because we have^ot paid attention to 
inequality among the objectives. Some objectives are . 
m f, re important than others, especially as we think 
about-individual students. * 

r ■ f - >*\ 
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Student Diagnosis 

At the present time insthictors are provided 
information of both general and specific nature. Also, 
they are usually provided some prerequisite irformation 
as well as the pre-instructional kind, and most of this is 
criterion-referenced rather than norm-referenced. The 
weaknesses here from the practitioner point of view, 
Jiowever, are that there is too much concern for the 
specific objective learning outcome and not enough 
concern for the means by which the student can obtain 
the knowledge. How long might it take a student to 
"master" a particular objective? Is it worth it at this 
time? What strategies should be employed? Watch' 
teachers...the first thing they want to eliminate now in 
many, programs is the pre-instructional tests<because the 
student time taken doesn't seem to have an information . 
payoff. Also, at the same time tochers tendj^ukeep the 
post-instructional tests and evci^tapose rigid standards^ 
What should be^the sta"n3ards fir whom, when, and / 
why? These mifet become part df the diagnostic and 
student assessment programs,. Here the computer can 
play a real role since it can store large quantities of data 
over time for many students. 

Instructional Resources ' * t 

Presently, we provide information as to what is 
available and often where, and how that should be usedr . . 
Some programs spend hours categorizing new resource's 
^nd materials anjd usually tfce updates are an, addition to 
what is already ,ther^ Good! However, what is now 
missing r information i on what foes what better, for / 
whom, and wfiy? What* is'needed Vinformation readily 
^cce$fy>le ,Jp the practitioner !(both student and \ 
^nstmcfor)^^jbari assist in short-term student planning 
in' a way thafc reduces the time for this planning. Part of 
<hf$ information ,shoufd be an updated analysis of how 
the Student is doing with the resources he $ using. There 
is a rfcaj caution that .must be stated hererthat is a 
caution against the crutch. Do we^have the^stSdent take ; 
the easiest route and create a crutch tjiat he can't live* 
vflftkout? ' ; 



Classroom Management Planning 



A real time-cqnsuming aspecUpf any instruction; 
program is classroom management planning. Presently, 
most systems provide information about, what /each 
student is doing and (his intanitetion oftcn-ipiplies 
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where the effort* takes place. What is missing noiv, 
however, is system information and suggested 
procedures for" using the information that can project 
student needs, relate these to resources and suggest 
alternative ways of matching the two. Again, the 
computer can assist in this aspect if we take the time to 
ask the proper questions. 

Pupil Outcomes 

And finally, just a word about 4>upil outco.mes. In 
contemporary CMI systems, information does seem to 
be available as to how well each student has 
accomplished both individual and group objectives. 
However, little information is presently available about 
proficiency levels needed by whom and when. As started 
earlier, this lack of analysis leads too often to certain 
rigid standards that may or may not have validity. 

General Concerns About CMI Systems 

Let me move on now and explore some general 
concerns that should be expressed about the present 
strengths and weaknesses of the information provided by 
CMI systems. Keep in mind that the total instructional 
management system is one that helps us relate all the 
pieces to the total or the whole. Presently we can 
provide information both to the instructor and to 
students as to what is going to be learned, what can be 
used to learn it, the student's readiness to learn it, and 
then whether or not the student accomplished the task 
satisfactorily. Also, we are able to have individual 
schools or individual instructors identify the objectives 
that seem important and necessarily to be considered in 
thfc system for a given course at a given time. This is all 
to the good. It can help us move toward adaptive 
instruction. However, this information base has builttin 
weaknesses that by their nature may destToy just what 
we are attempting to acb^ve. Since most CMI models 
are developed A J5e applied to the present goal model 
where the clearest goals are course otprogram goals and 
not the total educational goals, we may be building for 
defeat. This outccpne may occur because as practitioners 
use the system, those goals that are clearly stated and 
^included in the CMI system will become .THE goals. 
Other goals, though intended, will be lost. Also, with a 
few exceptions such as beginning reading or beginning 
mathematics, there* arc probably very few course 
objectives that must be mastered at a particular time by 
any great numbers. Keep in mind that, in any given 
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course or program, there are usually process objectives 
that are not only important to the particular course, but 
are important generally in learning. These are not 
presently included in most CMI systems since they relate 
to both content and procedures for learning tlu content,, 
for example, "example-rule or rule-example/* Many of 
our severe critics in elementary and secondary education 
in particular will be attacking us on the institutional and 
more general goals with probably good cause. What can 
be done about the present concerns? - 1) hopefully 
recognize them now, 2) next, for all levels we can pay 
particular attention to some of the weaknesses outlined 
above tinder each component, and 3) examine more 
carefully how technology is changing the outcomes as 
well as the means to the outcomes. In majjy instances we 
.have stated desired outcomes before -adding certain 
technological devices and systems, but these were merely 
stated and probably attained by only a few students.,But 
what is the overall effect when more students are able to 1 
attain these goals? What is the effect of superimposing 
these goals upon the goals of other programs or other 
courses? Who is not screened out of what because fhey 
have or have not attained these goals?-Directly related to 
thfc question is the question of who wjll select 
themselves out because they don't want to attain the 
goals. • 

What I am trying to point out here is that in most 
instances-the application of CMI, like the application of 
other technological devices, changes^ the student 
outcomes or the product and not merely the means to 
the end. 

Time-on-Task - & 

■ . Closely related to tfris concern js a concern for the 
present concept of "educational time" and its relation tb 
CMI. Presently, our concept of time in the educational 
sense is generally speaking a constant-credit hours, 
carnegie units, math, petiod, reading period, etc. We do 
vary these somewhat, but not a great deal. As we begin 
to adapt to individual needs, there is no real trouble with 
those who can accomplish the tasks in the same time 
that was allotted before or in faster time than was 
previously allotted. However, what about those.students 
who need more time? Where do<e$Lit come from and who 
decides? Granted, this is educationally a better problem 
to deal with than the problems that the present system 
creates, particularly at tlie upper elementary and high 
school level. However, to deal with this problem 



honestly and effectively we will have to" increase the, 
instructional tune for these students. This costs money 
and these additional costs will be blamed on the 
computer. We in this room have to begin to deal with 
the tensions created by programs that adapt to 
individual deferences. WeVe got to describe some of 
these outcomes before they become problems. Tfie 
time-on-ta«k concept is going to be a major problem in 
colleges for, keep in mind, we charge by credit hour to a 
large degree and we assign workloads by the skme 
concept. IV not play this out any further, but Fm sure 
you see the problem. These problems arj^not necessarily 
(he problems of industry or of the militafy. Also, (hey 
are not "the major problem in some educational 
institutions today since we are still mainly concerned 
with single courses as the major element. But. they are 
potential problems which could have a negative 
influence on development and* acceptance if not dealt 
with now. 

Summary * 3 4 

The variety of roles that the computer can play 
relative tp instructional management has increased. But 
we nte6< to Ibok at the functions that*it assists. The 
practitioner/does need assistance in measuring, tracking, 
analyzing progress, etc. But the practitioner has o.ther 
and sometimes more important needs that are 
overlooked. We need to work with and listen to the 
practitioner if we are going to build for what should be. 
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It is apparent from the number of CMI-related 
presentations being made at the various educational 
conventions hild throughout the world; the nurriber of" 
CMI programs bjeing developed at universities, vocational 
schools, industrial training centers, government training 
* centers, and even primary and secondary schools., and 
the assembly of this meeting which has brought together 
so many educators for whom CMI is a primary interest, 
that Computer-Managed Instruction is indeed a highly 
significant product of educational technology. The. 
impact* CMI will eventually have through making 
individualized education more universally feasible is 
probably hot recognized even in the excited "in-group" 
discussions held daily among CMI system developers. 
'But, in those discussions it is always observed that CMI 
has far greater potential for solving instructional 
problems and generally improving educational 
opportunities than is shown by the currently pperational 
— CM I-sy stems. } 

t . 

^ven though^many of us see CMI as a much more 
. promising educational tool, especially in the short run, 
tutorial CALdias seen the advantage of greater large-scale 
4 fusing and has drawn the fascination of many for 
whom CMI might be a more practical and satisfactory 
solution. CMI developers, being exfremely * cost 
coitscious, turned almost immediately from jhe 
development of programs in which the instructional, 
subject, ^matter was imbedded to generalized systems 
which heed little or no revision to accommodate a 
% variety of disciplines. In many cases, additional 
programming has been done to support insertion* 
modification, anil, deletion of course materials, by 
non-programmer users; but few if any have had^lhe 
.funds necessary to develop a fully .educator-oriented 
system having great flexibility for the'non-student user. . 
Programs to date^ while frequently of the generalized 
type rather than the subject-specific type* are developed 
^ to solve local functional needs. Because most systems arc ' 
programmed in higher leyel languages (e.g., FORTRAN), 
it is often said that systems can T)e modified to meet 
different needs rather easily. While this has been true in 
some cases, depending, of bourse, on, the" severity of the 
difference between the original functions the system was 
designed to provide and the new functions needed, 
systems have not been developed to provid'e a great deal 
of flexibility in support functions flexibility which is 
required if the systems can be said to be adaptable to 
varied and changing attributes of the educational 
environment. Flexibility is required if a single system is 



to be appropriate for use in institutions other than the 
one in-which it was originally developed. 

The purpose of this paper is not to detail the 
various features which- have been included in CMI 
•systems, but rather to 'briefly enumerate some of the 
attributes of educational environments which need to be 
considered in either the design or adoption of a CMI 
system. . £ 

7 *" 

Faculty and Staff 

Any instructional systefo which serves to augment 
humans in their capacity U> fttmujate and guide learning 
must give attention to the instructor/system interface. 
Just as it is important^ to provide individuals^ 
education opportunities.^ students, it tfalso important 
to_ allow instructors to specify the services CMI is to 
provide and the decision rules which the system is to 
^^follQw/ Systems which provide, such individualized 
support for the educator can be said to have variable 
management strategies!: 

, No single management strategy can ever be 
appropriate for all curricula, ali'instructional conditions, 
and all. instructors, but perhaps the most important 
element of the academic environment to be considered is 
the individual differences among the. instructional staff. 
There isAio system which will not ^prove a failure if it is ■ 
restrictive of the talents op he-mstructor or if it cannot 
be adapted-Ue'lrie instructor's needs. The following 

* examples show how only slightly different requirements, 
if not met, can render a'ny fixed management strategy 

f$ system unacceptable for a,given situation: ; 

•** - - * .»v 

Professor C. L. Rodgers conducts a law course 
which liases an overall objective that students will learn 
to locate on their own authoritative sources o|. * i 
ipformation. Throughout the course CMI is used Jo 
generate tests asking students for facts they must find in 
library, materials. Professor Rodgers uses the system to 
randomly -generate a Unique test for each student. He 
also requires the system to repeat the sam^-iinmas^ered 
tests (fitting correcjfjy answered questions) TfiwEfach 

* student until all the c<?rre,ct information is, supplied. 
End-of-test feedback should be specific with respect to 
the information still needed, but non-direcfyve-exccpt 
on tftfrd and subsequent tests-with respect t/ where the 
intorrnation can be found. 
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Dr. S. J. Swenson supervise* a large-enrollment 
physics course for college freshmen. A wide variety of 
multimedia instruction resources are available, but only 
in barely sufficient quantities. Dr. Swens6n t \yishfcs CMI 
to generate a new random test each'time her students 
request a test. End-of*test feedback should include not 
only a description. of the material mastered and not 
mastered, but also a listing of the available resource^ 
which should be most helpful for each student's 
itieasured needs. 

It is easily seen that Rodgers and Swenson would 
peed to specify different test and feedback generation 
jules, although other system functions might be 
Appropriately similaK Rodgers might Be interested, 
however, in generating 'a test asking the student what 
resources he had attempted to use when little progress 

-was indicated on subsequent tests, while Swenson might 
wish to hav£ students choose one of several instructional 
media* available on a given topic and have the system 

,jej3ort to fhe student the relative effectiveness of his 
choices. 

/ 

/ 

These example^ could be elaborated further 
showing how some identical features of CMI could serve 
both equally well and how very different features niight 
become necessary. The point is made, however, that any 
widely acceptable CMI system must have 
instructor-specified op*wns in the management strategy. 
Options must include selection of testing procedures, 
scoring procedures, type of feedback, sequencing of 
course topics, provision of optional course raodule.s, 
unrecorded practice tests, and many others. 

Other faculty- and staff-related aspects to be 
considered are listed below: 

1. Availability. In some cases, faculty cannot be 
readily available for studfent consultation. Systems 
that do not require "a subject matter expert to be 
present at . all times may be of value, while tho^e 

t which rely on the instructor to make frequent 
.pedagogical decisions and to provide information 
to students on demand cannot be considered. 

2. Willingness to Adopt a New Role. CMI tends 
not to support teacher-centered instructional 
practices and provide a new role for faculty as 
learning counselors. The breadth of variability in 
the management strategy of any system , 
determines to a large degree the freeddm of the, * 
instructional staff to teach the way they wish. 
CMI systems designed to support a narrow and 



\specifically defined set of instructor behaviors will 
require new users to conform to this instructional 
style and may, therefore, find a very limited 
general utility. 

3. Commitment to Individualized Education. 
Lack of a thorough .understanding of 
contemporary educational philosophy and 
commitment to its principles may be a good 
indicator of faculty . motivation to reform 
educational practices. Innovation is hard work, 
and tlie development of CMJ curricula is no less 
difficult. An existing low level of motivation may 
well change once familiarity with the instructional 
goals and technology is gained. Nevertheless, 
recognition that faculty may wish to spend far less 

, than . the optimal effort in courseware 
development suggests that highly sophisticated 
systems may be less appropriate than very easily 
understood and operated ones, at, least at the 
outset. Proposing a system which requires 
identification of learning hierarchies, specification 
of, complex te"stin|f*strategies,, and a complete 
restructuring of instructional resources is simply 
unrealistic for many environments. 

4. Confidence in Subject%fatter. Variable time 
learning systems sometimes provide a challenge 
which faculty are unaccustomed to in that 
students may raise at any time insightful questions 
concerning advanced course topics or very basic 
questions usually dealt with only in the -course 
introduction. When faculty of staff do not have a 
high degree of confidence in their knowledge of 
the subject matter, CMIV support 6f 
individualized pacing may becorne an" 

• unacceptable threat. CMI procedures can be used 
to provide reduced variance in subjects being 
taught concurrently, while faculty learn to deaf 
with some of the new challenges innovation 
presents. v C J 

K 5, Familiarity with Educatidnal Technology 
( Computing). Although many who support 
individualized education are more than capable of 
dealing with its challenges, many are also reluctant 
to bring the computer into the very humai) 
process of instruction. Fear of computer hardware 
or simple unfamiliarity in working with it may 
provide a significant problem for the CMI designer 
who must concern himself *with man/machine 
interface. It is necessary fox those who have little 
or no experience with computing systems-either 
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on-line or off-line-that their instructions be easily 
^entered into the system without first having to 
translate theip into an unnatural symbolic format. 
The extent to which these people perceive their 
ability to control the system may well determine 
its viability in the environment. 

6. Research Interest Some CMI systems are 
satisfactory to a particular group of users because 
the system provides an abundance of research 
data., Not all user groups are primari^nor even* 
significantly concerned with such data, however, 
and systems which emphasize experimentation to 
the neglect of accommodating the different 
pedagogical requirements would be clearly 
^unsuitable to them. Similarly, ' the lack of a 
data-collecting\£apability would make other 
systems unsuitablfcsfor those fior whom ease of 
educational expenrivettjfcmon makes CMI 
appealing. 

The character of the faculty and staff for whom ' 
various CMI systems were developed to serve can be 
easily determined by studying the specific attributes of 
any given system. But it can hi clearly seen, even from 
the extremei&brief listiftg arfd discussion above, that 
Satisfaction of locally identifi/d needs and the omission 
of concern fo*4titure needs, fcwell as for those existent 
at other institutions will reverely limit the universal » 
utility and value of the systim and most likely also limit 
the possible distribution ofAhe courseware developed for 
it. Alftlouglj faculty/ and staff demands and 
considerations may fomririse the most significant class 
of environmental attributes affecting CMI system design 
. and; operational success, a number of additional 
attributes may also be jj&erftified as having effects'which 
are by no means trivial. 

* ' / 

Courseware and Equipment . 



Since CMI is 
success is closely tfi 
occurred under th 
"teach," the quali 
manages has a lot 
therefore CMI's e 



instructional support system, .its 
with measures of learning which 
system. But since CMI does not 
of the instructional material it 
do with the learning outcome and 
ion. Only three of th* many 
courseware and equipment factors which influence CMI 
are^ singled out below as examples: 
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individual 
a very larg< 



Curriculuth Structure, The step 
>nal instruction format * to fully 
education managed by computer is 
one indeed. The more objective-based 
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and individuauzeHthe existing curriculum is, the 
less difficult CMI adoption will^e. 1} is important 
to recognize, however, that CMI* tends to be 
exasperatingly demanding with respect to the 
definition of' objectives and the identification of 
learning resources related to them. Any undefined 
component behayior will not be tested and no- 
study recommendation can be made when it is not 
mastered. Higher level behaviors building on such 
components may not be mastered becaiise of trie 
incremental learning deficit, an d t h e system's 
being unable 1o determine the real cause will not 
suggest trply appropriate learning activities. No 
matter how sophisticated the CMI design, flaws in 
curriculum structure will be magnified by the 
fystem until restructuring is^accomplished. Such 
flaws may ultimately brihg discredit to the 
particular CMI system in use and erroneously 
indicate that less exacting methods of 
instructional management are superior. Judicious 
avoidance of such a frustrating situation may be 
accomplished by refraining from the introduction 
of CMI when the existing curriculum structure is 
inadequate and when.a serious restructuring is not 
feasible. 

2. Individual Learning Resources, Some CMI 
systems such as the one in operation fn *the 
Introductory Biology Project at The Ohio State 
University (Allen aL, 1972) provide a practical 
means for^ the > management of available 
instructional resources without the requirement of 
constructing special ones to meet the needs of the 
•system's sttTdy prescription generator. At the 
heart of this design is th? recognition that 
available' resources max not relate to a single 
objective but rather to an identifiable group of 
objectives. Recess to a relatively large library of 
such commonly available resources permits 
computer comparison of the s©< of measured 
student needs and the composite sets of needs 
served by the possible combinations of selected 
resources. An algorithm which can take into 
account previous prescriptions generated for the 
student, preferred instructional media, etc. is then 
used to recommend a study prescription. 

Although individual learning resource 
management such as the? one described can 
overcome .some shortcomings in the resources 
themselves, the quality and quantity of, resources . 
available strongly influences the value of CMI. It is 
vitally important that some of the resources 
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available cover specific behaviors. A CMI student 
studying FORTRAN, for example, cannot 
reasonably be expected to study )a textbook 
chapter on algebraic expressions wjjen he forgets 
whether addition or multiplication operations are 
executed first. A simple instructive paragraph 
would be^much mpre satisfactory. Appraisal of 
the resources available, the possibility of acquiring 
additional ones, ajnd the flexibility of CMf^ 
- prescription generators available is extremely 
important. 

3. Learning CenteKLocation and Hours. In a 
university environment students may have access 
to a learning center at almost any hour. If this is 
true, an online systemXhas many advantages in 
providing service to the Student wtffen he wishes. 
The location may not proVide cpnvenienUwcess, 
however, and \Sw*rt*ra*)^^ 
upon arrival at/ihe center, resource^? ready and 
available. Certain combinations of location and 
hours make deiRiaodasMj the types of CMRservicesy 
offered, such as scKedtHJing, on-line or loff-lipe 
testing, "mailbox" communications, jm4««*fiers. 

Computihg'Sefvices* * /■ 

Obviously, the computer hardware andlsoftware 
available dictate many of the constraints undVr which 
CMI must operate, but system"; modifications and 
addition^ may often be made which will benefit }he CMI 
users. Systems diffeY in the extent to which educational 
system users become dependent upon computer center 
personnel and services. On-line systems. ft^afre much 
more commitment to CMI from c^ipute^r center 
' than do batch systems, but even wUfiWlnese two classes 
of systems there are differences in tip* degree to which 
data processing professionals nwstfbecome invoked. 
Local situations determine the dfefee to which Jtach 
dependence is advjsable. The. advis&Mty of cadffiilly 
considering this factor can be attestea^HQ^pmany^ 
frustrated CMI.proponents. > ' I 

Nothing destroys CMI more rapidly than/the 
negative attitudes developed by students trying to/cope 
with an unreliable system. Service reliability is important 
in determining whether to implement CMI at A as well 
as determining what kind of^ysteta to tfse. Again, 
on-line systems are, for example, much mofe sensitive to 
the quality of service than are batch systems. 

'Many other factors in this category such as hours 
of system availability, *tum arOund time, possible 



communication speeds, and type of mass data storage 
available are just as important as those discussed above, 
but sim£l^ cannot be itemized here. The statement 
should be made clear, however,^that the nature of 
computing services available is as important an 
environmental factor influencing CMI as any of the 
others. 

Administration v ' M ^ 

As a part of the. educational envirbhment, 
academic administrators exert both direct and indirect 
influences on CMI outcomes. Certainly policies of giving 
professional recognition for instructional innovations in 
general and for those using computer technology in 
specific iiave much to do with the future of CNJi in a 
given institution. CMI is not always cheap (although 
there are dramatic demonstrations of its ability to 
reduce training costs) and it is not minor part-time 
activity (although systems differ greatly in the time and 
effort required for course implementation, operation, 
and monitoring). Administrative support ©f CMI- is 
indeed necessary but not sufficient for succe$s.« 

Administrative demands for instructional 
accountability, constraints on student/faculty ratio, 
needs for instructional cost reduction, and values for 
individualized education should (and often must) be 
considered not only in considering whether to use CMI, 
but also what criteria should be used in selecting a 
suitable systenj design. CNrt systems are often designed 
for the ideal environment which, for example, permits a 
student-variable learning period and supports a fixed 
minimum achievement cjuterion. Administrative 
requirements, on the other hand, permit variable student 
learning within a defined time period at the end of 
which a performance grade must be produced. Such a 
system design and educational environment are simply 
incompatible, and some kind of adjustment -must be 
made. For this environmental factor just as for all the 
others identified. in this paper, it is well worth the effort 
to consider the possible effects it will 'have on CMI. 
before a specific system is implemented. 
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The military environment is very conducive Jo the 
-development of CMI. In general, the necessary 
iiigredients are already in existence. There are five major 
considerations. 

Centralized Facilities 

Schools and training centers have been establi^ied 
where similar kinds of training and education take place. 
For example, Army communications subjects are taught 
at the U.S. Army Signal Center and School, Ft. 
Monmouth, New Jersey; Army medical subjgctsfcare 
taught at the Academy of Health Sciences at Ft. $arn 
Houston, Texas; Basic Airman training is taught at 
Lackland Air Force Base, Texas; foreign languages are, 
taught at the Defense Language Institute, Washington, 

^Full-Time Learning ' 

Students go to school for a scheduled eight-hour 

day. There is variety in the schedule-not all eight hours 

*are lectures. Any training day might contain a variety of 

lectures, demonstrations, practical exercises, 

laboratories, and individualized study and research time. 

Going to school is considered a part of ofte's job in_ the 

military. * 
j 

- 

Defined Jobs 

In the Army, the Military Occupational Specialty, 
referred to as an "MOS" is a job. All MOS's are defined 
by a job description that is valid Army-wide. The other 
services call their jobs by different names, but the 
concept is similar. These "jobs" range from technical 
skills to broad administrative and professional activities. 




» MOS-Producing Courses. These 
students to perform the job skills 
performance on the job. 



courses traia 
necessary ' for 



'* Nbn-AfQS Producing Courses. These' are 
professional courses for career persons, for skill 
advancement within an MOS and fof covering general 
topics that are independently ' required of a specific job. 

* » . 

Instructor Development 
• * 

Unlike almost all posts^condary educatiqn and 
training institutions, the military actually teach subject 
patter personnel "how-to*teach" in the service 
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environment.. The Faculty development Course at the 
Academy of Health Sciences, for example, teaches the 
potential instructor how to write student-oriented 
instructional objectives. He is then taught how to 

< ofganize instructional content \yithin a chosen method 
of instruction for designing lesson plans that will alio* 
and facilitate the students' learning. The instructor 
bandjcfifre is then taught how to evaluate student 
performance. Further, he is taught how to communicate 
to the student from tfie platform as an instructor. . 

. Instructional qu&lity is also monitored after the training 
course with feec^ack given to. the instructor fQr the 
purpose Qf self-imprpving his instruction wherever 

- -fij^ssible. I n 

CourifcDesign 

* Courses of instruction are (iesigneikjlfcugh what 
' are called "Systems Engineering" procedures. This is a 
.formal procedure forsaking a course of instruction as 
effective and efficient as possible. At the Academy of 
Health Sciences, for example, tfie following procedures 

are used. * 

c I * 

Task Analysis. The required tasks are analyzed to 
determine ^ontenCand sequencing requirements. Some- 
skills are selected for training, others will be required as 
prerequisites, and some will be deferred to on-the-job 
training. 

Evaluation Plan. An evaluation plan is specified 
and is designed to evaluate the students' performance 
level and the effectiveness of the instruction. 

V * 

Instructional Controls. The systems engineering , 
procedures facilitate the development of a Program of 
Instruction (referred to as the POI) which completely 
defines the content of a course of instruction. Lesson/ 
Plans (referred jo as LP's) are then designed and written 
by individual instructors to cover all of the scheduled 
hours in th^POI. These lesson plans are reviewed as to 
their adequacy in facilitating learning so students can 
accomplish the required objectives. 

Quality Control. The instruction that tikes place 
is higtyy efficient'and effective in accomplishing learnings 
of the required knowledge and skills. ^ rough the 
systems engineering processes thfi^kt^n continues, 
making sure the graduate cai^erform ,dTi the job, and 
that both the job holder and the supervisor are satisfied 
with the work being performed. / 
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Unlike its academic counterpart, industrial 
education and training are at best sidelines/of the 
nation's business organizations and are, wjtn limited 
exceptions, hardly the reasons for these organizations' " 
existence Therein lies the rationale behind many of the 
observation^ made below in briefly discussing the 
characteristics of industrial education and the potential 
adaptability of independent study techniques (i.e., 
computer-managed instruction') to the industriaPscene. 

To industry, the education and training function 
represents an e*\pfcnditure of no small magnitude, at 
times exceeding the budgets of leading state universities. 
From the standpoint of instructors, most of whom did 
not receive "their baccalaureate training in teacher - 
education, and their associated salaries, there are few 
industrialists who would not delight in being able to turij 
over their complete education requiremeitfs to education 
institutions if this move were possible. There, are, 
however, a number of characteristics of the industrial 
training requirements and a small set of limitations of 
academic institutions which together inhibit that 
transfer. Let's observe those characteristics. 

Industrial Curricula 
u 

n 0 , Industrial curricula tend to be specialized, dealing 
with the unique products or services rendered by the 
various firms. Economies achieved by offering a siftgle 
course to a large student body centered at a single site 
r . are seldom present. Compoundiri^the problem is that 

^/x^tafemies gairl^a through repeated j^rings of the same 
course over extended periods are not present. The reason 
for this conclusion- lies in the fact that industrial 
education tind training is product-oriented and it is 
common for pr6ducf lines to be dynamic, thus requiring 
frequent curriculum changes. Not only do the objectives 
of the education„and traii^^e^erwnce change, but so 
do£J$e reference materials ^^(piated with the courses. 

^S^cCof the nat&n's leading industries virtually become 
smaltj^olufffe publishers ouHWf hecessity, unable to take 
advantage of the economies associated with large volume 
text output, an adyantage Veen in the more stable 
academic course areas. 

Demands on the industrial education system also 
tend to be a bit foreign to those placed in a traditional 
academic institution: Industry does not- run on aj|^ 
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academic semester or term basis. Rather, ij must be 
prepared within reason to provide education ori demand. 
Where high turnover of employees is common and 
r new-hire programs are constantly in place, few, industries 
can afford to have trainees unproductive for weeks 
waiting for the beginning of a formaT coufse. This 
economic concern is shared with the military to some 
extent. ? 

The need for on-demand training more often tharif^ 
not results in small group education. Where traditional 
classroom instruction methods are used to satisfy the 
requiremenr\of^these small groups, tjie salaries of both 
the instructor and the students .combine* to make 
staggering cost for education Expenditures. * 

, Contributing to the inability of professional 
educational institutions to handle the education and 
training requirements of industry is the frequent . 
occurrence of little advance notice of the need for a 
training requirement to be fulfilled. T}ie lattec is simply 
< the result of an industry's attempts to respond upmarket 
variables which; result in in<5reased/decreased production 



output and product line changes. Both of these may. 
require education redirection in maintaining* 
knowledgeable workforce. And - then t there are the 
employees themselves who frequently do nojUesemble 
next fall's incoming freshman clajs at the local 
university. ' , . 



Industrial Students 



What are industrial students Jike? Their academic 
background may bifthat of a higruschool dropout to 
professionals with multiple doctorates. In age and 
experience v^tn a particular industry, the range is wide 
and divetfe. The same can be said of learning abilities 
present ir) tjje workforce. Organizations which decline to 
train the bolder employee in new technologies find 
.♦themselves top heavy with highly paid, 
s£rrti-nonprodu{,tive administrators. As wide as their age 
and experience spread may be, the .industrial employees 
do have one common bond. They are motivated by' 
dollars. Where an education opportunity presents itself 
and is recognized as an opportunity to secure those 
dollars, that opportunity will not be ignored, but at the 
same .time not necessarily capitalized up6n 
unconditionally. 
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The industrial employee wishes his/her education 
opportunities to be convenient and not cause/undue 
hardship. Labor unions frown upon "homework" and 
often insist upon overtime pay if after-hours study is 
required. And then there are peer concerns. The 
iAdustrial. employee may„ decline a highly desirable 
* educational opportunity if the learning environment * 
could put him or her in an embarassing position in the 
presence of peers or management. Once Saving chosen 
an instructional opportunity, the industrial student will 1 
usually place a number of personal demands on the 
system being used. Since the output of the course could 
1 directly impact salary, quality education is of great 
importance. Although the media is of importance as it 
relates to, peer concerns and convenience, the message 
represents dollars. To assise themselves that" learning is 
taking place and^will have staying po>ver, the industrial 
trainee demands feedback and ,tei)ds' to be 
print-oriented. He or she will invariably evaluate class 
effectiveness to some degje^ on the amount of reference 
* and follow-orpfesburce material supplied. 1 

With/ this student profile in mind, the reader could 
conclude 'that aft independent study system such as^ 
computeyiiaQagkiJ^te^ much To. 

— ^^-^^tMustrial education and training. That might be a bit 
preemptive, however, if one fails to examine what 
industrial managetpen^looks for in an education system. 
" Th*ey too are dollar-oriented, witlTthe' profits of Jhe- 
coVppration chiefly under consideration. 

./Industrial Management * 

k | What does turn management oa relative to 
education? Unlike most academic institutions, industry 
place$ a dollar value on their "student's" time. Although 
management would prefer thaMiil or their employees,', 
time be invested directly in producing goods/ and 
services, they recognize the importance of investing time / 
in edUcation-but as little as possible. If, through the. 
. proper investment of that, time, the morale of -their 
workforce is- improved, management is quick to 
recognize thp indirect value of sound instruction in 
increased output and decreased personnel problems. * 
k Rarely will sound management imply that they are not 
interested in improving the quality of the education 
produced by their training, departments, but with the N 
same rarity will they say lha} that interest is their major 
one. If a new methodologyAvill maintain thd company's 
current level of education at reduced cost with increased 
availability of i motivated workforce for direct 
productive activities, that technolclgy is certajn^to gain 
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attention in an industrial setting. But, possibly nothing 
more than attention will be gained unless transition to 
the new method appears {jgasible. 

' Conclusions 

Having described in brief the environment -of 
industrial education and training, the concerns <jf- 
management relative to the significance of instruction 
technology, and the profile of the industrial learner, the> 
writer suggests that independent study tpctfniques in 
general arid computer-managed instruction in particular 
offer mucji toward meeting the needs mentioned above. 

The track record for the successful introduction 
of instructional technologies requiring radical changes of 
current educational systems ha£ been a poor one, 
althougfftadmittedly far more impressive in nonacatfemic 
-environments than wifhin<\ .academe. Technologies 

* requiring r extensive curriculum preparation formats, such 
as programmed instruction and tutorial CAI, have been 
slow to, take hold. Where entry -costs have been high 
because of the insistence upon specialized Computer' 

..hard ware a nd software, only the researcher with hands" 
and* hat extended Jias Seen able to scale the barrier. 
Nevertheless, where entry hSs been made via the 
computer in industrial settings, the success .of the 
technology as a manager of instruction dissemination*. , 
and as a afescripter of education has.'gone for the most 
part^upchallenged. Although the conclusion could be 
premature, there is data to suggesPthat* CMI has a 
significant role to play in industrial education and may 
represent a" road, to th6 successful use of some of the 
mote exotic technologies which have been slow to 
activate and of which CMI could be a fundamental part. 
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PART II 

' DESCRIPTIONS OF OPERATING CMI SYSTEMS 
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MULTIFACETED COMPUTER-BASED COURSE MANAGEMENT SYSTEM 

' Thomas H. Anderson * ^ 

University of Illinois/ Urbana 
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The Course Management System (C\fe) was 
designed to integrate books, computers .and live teachers 
in an effective manner. The system is intended for 
courses with large numbers of students and instructors, 
such 2S introductory courses in community college, 
university, or military setting*. The logistic problems 
associated with multifacet^d instruction programs and 
large numbers of student^ and faculty were solved, in 
part, by using a Computer-Assisted Instruction (CAI) 
system. 

f In the managed course, students are expected to 
^uireJ)asic information concepts primarily from 
individn^ reading. Their attention to the material is 
maintained and their progress monitored by a previously 
developed and evaluated study management system, 
SMS (T. Anderson et 0/., 1974). SMS intermittently 
questions Ifte student about what he is studying so as to 
maintain deej) cognitive processing. In practice, the 
student signs in at a computer terminal and receives a 
brief study assignment in his textbook. Upon completing 
the assignment in a nearby workspace, the.student "again 
signs in. This time he receives a short quiz over the 
assignment just finished. The cycle starts again with the 
next assignment. 

Lectures and standard quiz sections are little used 
in CMS. The time of instructors, saved because routine 
^ctuiing and review are no longer reqiiireu, is invested in 
remediation for students having trouble mastering the 
core curriculum, and in teaching' a smorgasbord of 
topical, high interest, activfty-oriented seminars and 
special projects. The role of the computer is to manage 
study behavior, administer on-line achievement tests, 
and schedule group tutorial and seminar sessions. The 
managed course features mastery learning and permits 
able, hard-working students either to complete the 
course in as little as 12 weefcj^or opt for extra credit by 
takin^additional seminars. * 

CMS is being tried out this semester (Fall, 1974) 
in an introductory economics course on the college level 
with 360 students. To date, achievement data support- 
the contention that students can acquire basic 
information from individual reading. Students are 
scoring as Well on achievement tests as did students in 
previous semesters with lectures and discussions. In 
addition, according to questionnaire data, students lijce 
the seminars and their high seminar grades indicate that 
the students are performing well. 



PLATO IV, an interactive CAI system, is utilized 
in the project. Terminals are located in the r 
Undergraduate Library,. foreign language* bulling and 
College of Education building. During the first, second 
and third semesters 70, 100 and 360 students, 
respectively, participated in CMS experimental courses. 

CMS was designed by the Departments of 
Psychology and Economics of the University of Illinois. 
The Advance^/ Research Pfojects Agency of the- 
Department of Defense and Navy Personnel Research 
and Development Center funded the project. (Contract 
No. N61339-73-C-0078) Additional information and 
project demonstration are available by contacting Dr. 
^ThuiudS H. Anderson, 226 Education Building, 
University of Illinois, Urbana, Illinois 61801 
(217/333-8287). f 
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The Sherman Schpol CMI Project is a cooperative 

effort of the Madison Public Schools and the University 

of Wisconsin. In 1969 the staff of the Sherman School 

developed the curricular plan and ^instructional model 

described belotffr to individualize their mathematics 

program. In 1971, the CMI software was developed ant} 

used on a demonstration basis in the spring of 1972. Full 

operational use began in the fall of 1973. During the 

summer of 1974,.a large number of refinements in the 

curricular plan, instructional nfbdel, and the computer 

software were made to incorporate the first year's 

experiences. The CMI project is currently inks second 

year of full scale operation involving seven teacfters, two 

teacher aides, and 165 pupils. It is also in its first "year of 

three years of supgprt under Title III, ESEA. The 

funding will "exterid the use of tlje .system to other 

schools and other curricula as well as transfer full 

responsibility of the computer component to the 

Madison Public Schodfs. 
i 

The CMI system is used to manage a combined 
fourth and fifth grade "conventional mathematics 
ciu/iculum. The subject matter of the two grades has 
bj&n divided into 63 units of instruction, each having six 
objectives. The units of instruction are? arranged in a 
linear' structure with major topiofcippearing in a "spiral 
staircase" fashion. Review units appear roughly every 
five uAits. Each unit has associated with it a pre-test and 
three post tests, each covering the six objectives ot the 
unit. These tests are penciland-paper tests that are not 
amenable to machine scoring. Due to the linear structure 
of the curriculum, each unit has only one prerequisite. 
Locally prepared study guides in either printed or audio ' 
tape form are used to introduce a unit to a pupil. A 
variety .of textbooks and locally developed materials are 
employed by a student to study the objectives of a unit. 

* The instructional model is analogous to a mbdical 
clinic where teachers perform specific functions and the 
pupils move freely from one station to another. During 
the mathematics period, the complete second floor of the 
school is employed and the pupils in the seven 
classrooms merge into one group ;of 165 pupils. The 
basic instructional cycle begins with*a pupil taking a unit 
pre-test that is scored ort an objective mastered, 
nonmastercd basis?* by a teacher aide. The test results arc 
given by a pupil to another teacher aide who operates a 
computer keyboard terminal. The objectives .not 
mastered by the pupil are entered and the computer 



generates a "tear-off sheet" that is given to the pupil. 
The sheet contains a list of seven prescriptions for each 
nonmastered objective and designates the 
computer-selected "best" prescription. Upon completion 
of the prescribed activity-typjcally problems from one 
of the textbooks-the pupil's work is reviewed by a quiz 
teacher who ascertains if the pupil is prepared to take 
the unit post-test. If not, the qjiiz teacher can assign 
additional prescriptions from, trie "teaf-off sheet" and 
the cycle is the same as Um "Pre-test. Mastery on five of 
six unit objectives results in a forward prescription to. 
the next unit. 

The instructional model employs fate of progress 
as the basic dimension of individualization. Due to the 
use of teachers in the testing room, study room, seminar 
room and as quiz teachers, each pupil liaa considerable 
teacher contact and individual attention uhder the 
model. 

The instructional management philosophy focuses 
upon management of the unit cycle described above and 
upon rpanaging the pupil's progress through the 
curriculum. Instructional decision-making and 
management decisions are based upon four different 
reports printed by tWe keyboard terminal. These are a 
Student History^ Report which contain* a complete 
record £f a student's instructional history, a Group 
Report lUtiflg' pupils by, homeroom and showing their 
currently assigned put, an Objective Report listing the 

-names of pupils working on each unit, and a Contact 
Report containing^the names of pupils having no contact 
with the computer since a given date. It should be noted 
that the teachers have no grade books for mathematics 
and 'all information is stored by the computer. The 

? reports are used to monitor student progress, detect 
patterns of pupil achievement, prepay report cards, and 
to evaluate the curriculum. 

The computer software .supporting the Sherman 
Schbol CMI project is a general purpose CMI package 
called "Managed Instruction with Computer Assistance" 
(MICA). The software was conceptualized, fully 
documented and implemented by six graduate students 
as a homework assignment in a two^semester computer 
soience course. The MICA prografri of approximately 
6,000 lines of FORTRAN V was written for the Univac 
J 100 series of computers and employs a locally 
developed virtual memory capability. / 
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. The* MICA* software is highly modularized and 
access to its various capabilities is via a simple job 
control language. The computer-teacher dialogue is such 

^ that little* training is required in order to use the system. 
The MICA software systen) is built upon a sophisticated 
data base management, capability that supports ihe 
jclassroom use as well as the data base maintenance. The 
data base consists of five major files: Student History, 
Student Data, Group, Unit, and Prescription. 

* Dictionaries containing the actual student names, 
prescriptions, etc. are used to provide a modified index 
sequential file schepie. Header records are associated 
with each fi^p that describe the elements within a record. 
Documentation at the system concept and system design 
level have been written as part of the MICA development 

process. , 

• > * 

The MICA software system is also being used to 
demonstrate the management of a modularized teacher 
education program via an interactive terminal. , 

The developmental cost of the MICA software was 
roughly 570,000. Operational dbsts for the first year ' 
were $2,000 for computer time, $2,000 of teacher time' 
- to clevelop the prescriptions, $3,P00 to create the data 
base, and ,$5,000 of programmer time to 'maintain the 
system. * . ' • ✓ 
* 

' The Sherman School Project has been a classic 
example of iterative development of a sound underlying 
concept. There has been considerable interaction among 
the curricular plan, the instructional model, and the 
*^MICA software. The total developmental process has 
* ■ -! 1>een under the direct control of the classroom teachers 
with the support -of various specialists. 
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The yision of an indiviSualized school in which 
each student is prdgressing independently of any otherf 
finishing and starting courses at anf fime artd having the 
option of changing his grade *cbntract or schedule 
whenever he wishes is the dream' of many instructional 
technologists, but it conjures up a chaotip nightmare for 
most school administrators. . 

The otyective of this information system was to 
rectify that chaos. It was developed for a totally 
individualized secondary school, grades 7-12, but it is 
also applicable to most individualized postsecondary 
situations. 

The system to* be described is not involved in 
instruction per se^ i.e., it does not include CAI functions 
such as sublet* matter presentation or drill and 
practice-npr at thsprejsfnt time does it encompass any 
•diagnosis or prescription. Such functions can be and are 
performed on the same computer, but *s yet they are 
not integrated. 

Why is such i/system needed? My own rather 
extensive experience with individualized instruction has 
led me to believe that t|iere are several important 
reasons, although some of. them may cause my more 
liberal acquaintances Who are proponents of 
unstructured education to label me as an arch 
reactionary. 

In visiting numerous "individualized programs 
around the country, I have, become sensitive to the fijgt 
that in most of these'institutionsit is fairly common for 
a student to beViaking little or no progress, and no one 
is conscious of the fact that he is "lost-" Consequently, I 
feel an urgent need for a system that will record and 
report on each student's progress, . 

Even though I am a staunch advocate of 
individualized, continuous progress educational 
programs, I cannot endorse the concept of "each student 
progressing at his own pace." Some students are 
seemingly quite content to make no progress at all. 
Rather, I believe that each student should have a 
goal an individualized goal jointly agreed to by the 
student, his advisor, and his parents and that his 
progress should be reported relative to scheduled 
progress toward that goal. The reporting system should 
generate exception reports which clearly flag the 
students who are significantly behind schedule. 



Another somewhat controversial concept in 
secondary education is the "open campus." Personally, I 
don't think that most junior and marjy high school 
students are able to cope with that much "freedom." On 
the other hand, I do believe that it makes a great deal of 
sense to allow a student to make up his own schedule 
(with the approval of his advisor). Some students prefer 
to spend, all day Monday on math, Tuesday on English; 
others may have all kinjds of legitimate reasons for 
preferring one schedule uver another and even changing 
^ it as special projects or activities arise. The advisor may 
also wish to schedule a student for more time in the 
English Department and less in the Science areas, the 
objective is to have a simple, manageable procedure for 
"changing schedules at k friquent intervals and then to have 
a method of checking to make sure the student is 
actually where his latest schedule indicates. 

The "bugaboo". of many individualized learning 
programs is the tremendous record-keeping load that is 
imposed upon the teacher. Thus, another major 
requirement is that, insofar as possible, all the input* 
should be generated by the student and not the teacher. 

Most of the features of the system to be described, 
were in operation last year on a remote job basis to the 
National Educational Computer ♦ Service. As a 
consequence of NIE's termination of suppurt for that ' 
project, we are rewriting the package for a self-standing 
PDP-11 system." The scheduling cornpor^nt is. now 
operable and we hope to again have the entire system by 
the end of the school year. . » *" 

There are three major types of input. The first 
type builds the basic files of teacher names aitd numbers, 
student names and numbers, and coufte name^, 
. numbers, teachers^room location and any scheduling 
restrictions.- These inputs are by conventional punched 
* cards. 

The second form of input is the schedule deck. 
Each student is issued a student card pre-punched with 
the stent's number and a pre-punched card for.each 
period in the week. The student then picks up a 
pre-punched course card for each course he is taking. 
Since our card reader can Tead eithet pencil marks or 
punches interchangeably, the student inputs his grade 
contract, the starting date, and the scheduled 
completion date for each course by marking the 
appropriate card locations on the course car.d. He then. 
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assembles his schedule ,deck in the following manner, 
first, his student card; next a course card followed by all 
of the periods for that course, then another course card, 
followed by all of the periods for that course, and so on 
until all of the course cards and period cards have been , 
used. This deck then serves as tjie input, to _ the* 
scheduling program. The student can generate a new 
'schedule simply by reshuffling the order of the card^ in 
his deck. He will keep the same deck for all six 
years-adding or deleting course cards as appropriate. ^ 

These altered schedule decks can then be run 
either once a day or once a week as desired. The nev/ 
schedule is printed out and becomes effective as of the 
following day. • " 



Similarly, weekly course lists are prepared for 
each teacher showing each student's progress relative to 
,his own individual schedule and indicating when that 
student is scheduled to be in the related learning area. 
The principal gets an exception Ust indicating all those 
students who are more than sojne ^sgejafieTTriumber of 
days behind schedule in a course. Obviously, many other 
types o£ reports and statistical analyses can be generated 
to assist in the managemjpit and improvement of the 
institution. 



As is; essential with any student-generated input, 
th&re is extensive editing to ensure that all periods are 
used, that courses haven't been dropped without 
authorization, etc. The program also detects any course 
additions and prints out a course addition list for the 
appropriate teacher. 
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• The third- type of input is a "test card" that 
records the students' 'progress in their courses, A supply 
of test cards pre-punched with a studerft's name and 
number is stored at a convenient location. A student 
who wisheslo take a post-test on a learning packetpicks 
tip one Aji these xards and marks on it the date, the. 
course number, the learning packet numbers and his 
^de'eontract. Heathen presents 'this c*rd to get his test 
and it is clipped to the test. When the teacher grades the 
test,, he makes one mark on the front of the card to, 
indicate whether or^not the student met the passing 
criterion (usually 90%). IJe then writes any comments he 
may wish to make to the student on the back of tjie 
card. These cards are entered into the computer each 
morning and then distributed back to the students. Once" 
again there is a very thorough editing routine that 
detects almost every conceivable error the, student might 
make. * 



* With all of this data in its files, the computer can 
generate myfiads of reports. Some of the most 
important arc the learning area rolls— for each period of 
the day, the report lists the students that are Scheduled 
to be in each learning area and' indicates for each the 
course that he is scheduled^for and the number of days 
that he is ahead or behind schedule in that course. The 
area supervisor then knows which students should be 
closgjly supervised. 
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At The Pennsylvania State University in the 
College of Education, graduate and undergraduate 
courses offered with both computer-managed instruction 
(CMI) and corftputer-assisted instruction (CAI) are being 
used and accepted with a high degree of satisfaction. The 
two systems are being used jointly as well as 
independently defending on the type of instruction that 
the instructor^ chooses. Because of this dual role of 

- computer technology in instruction at Penn State, an 
instruction support system (acronym ISS) has been 
impl^rriented withthe underlying implication that it is a 
large* system usinj^iany different types of technology to 
support and/or manage instruction. Thus,Pehn State has 
both an interactive .data^ processing system (CMI ( + CAI) 

' and a batch datfprocessing system, both operating 
under the aegis of ISS. For example, one course 
(Language Education 441-Teaching of Children's 
Literature) utilizes the CAI system for measuring an 
individual student's competency in basic knovWedge in 
six separate areas^pf children's literature, while it utilizes 
the batch data processing for daily feedback and weekly 
progress reports of all competencies, including those 
utilizing the CAI system. Other courses (Curriculum & 
Supervision 401 -Test & Measurements, Counselor 
Education 425-The Use. of Tests in Counseling, 
Mathematics Education 420-Teaching Mathematics in 
the Elementary Schools) use batch data processing only. 



ISS is a system aimed to support individualized 
instruction. It has the flexibility to perform a variety oP 
computation pski needed for„eValuative variants as well 
as individualized fecord-keeping and varied feedback 
control. Thus, while ISS has its origin in the. College of 
Education, which initially felt a need -fS^plernent a 
competency-basdd teacher education program, it is a 



system which is 
area at any level 



One of 
individualized i 
process. Penh 
sophistication 
primarily 'depen 
mapping flexib 
accommodate 
numeric and*>urf 
student concern 
and/or weekly, 
Penh State in all 
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adaptable to fonps of instruction in any 
of complexity. 



the underlying assumptions of 
instruction is the diagnostic-prescriptive 
State's. *SS has this capability. .The 
the diagno&tic'prescriptive process is 

!ent on the instructor sin^e ISS has a 
ity of larfe proportions x artd can 
^e instructof's prescrjptjonsf in botjh 
jtten language form, feedback to the 
Uig progress can be immediate, e daily, 
s desiredUISS is presently operating at 
thrfcfe modes. 



The standard ISS input form accommodates the 
variants described above. Once th$ input has been 
prepared the data are initially transferred by means of 
the OPSCAN 17, an auxiliary non-computer apiece of 
equipment, which senses the darkest mark in a given area * 
and sends put an appropriate signal to an external 
device. The external device in ISS is a remote-job-entry 
silent typewriter terminal with cassette tape capabilities. 
The data are thus transferred by means of the OPSCAN 
17 to a cassette tape mounted on a Texas Instruments 
(TI) cassette terminal. It is then possible to edit the tape 
off-line to make any necessary corrections before 
sending the input to the computer* When the tape is 
ready, a telephone connection is made between the TI 
terminal and an IBM system 370 Model 168 computer. 
Tru^data are then transferred from the cassette tape to a 
disk file connected to the IBM 370/. At the University 
Confutation Center, these- files are referred to as batch 

- and terminal or BAT files. At this point the software of 
IS£ {written in WATFIV, a versioj} of FORTRAN) is • 

0 6?cecuted and either a daily report or an accumulated 
progress report is produced ^ depending on the 
instructional course design. The job is initiated from the 
terminal and the output, routed to a high-speed printer. 

The apprbximate cost for daily printouts from ISS 
per 100 daily transactions is $2 per day. At present Penn 
State- has one course utilizing weekly progress reports in 
addition to the daily printouts. This weekly printout 
cost depends on tjie'number of students. At present the 
one course Utilizing this procedure has 142 students 
enrolled. A duplicate set is printed each week, one for 
* the student and one for the instructor, and its operating 
cpst for these 142 students is approximately $6 per 
week. 

Computer-managed instruction in the form of ISS 
at t The Pennsylvania State University is operating 
efficiently and effectively .»ath students and instructor^ . 
who are dedicated to qualiQ\}nstruction have found ISS^ 
indispensable to quality individualized instruction. 
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The Capital 'Area Career Center has developed a 
Computer-Managed Individualized Instruction program 
that addfesses itself to three factors. We needed a 
curriculum and a system that: 

- takes into consideration the competencies of each 
student in the selection of occupational training 
Objectives, sequence of study, choice of materials 
and procedures, 

- allows a student to spend whatever time he finds 
necessary in a given subj^t area is determined by 
his performance rather thanl>y the clock, and 

. k - 

- measures each student's progress by comparing his 
performance with specific objectives rather than 
other students. 

A Univac 70/2. Computer was used in essentially 
two ways: first, to analyze the data received from 
industry, and second, to manage the instruction. The 
first item, analysis of the data, was accomplished with 
the use of a technique of industrial job task analysis, 
sometimes referred to as critical incident studies. 
Representatives from" industry and education designed 
job task analyses to determine what a person needed to 
know in order to perform each occupation properly. The 
five areas of competence scrutinized in the job task 
analyses were: 

1. Job Skills - The observable, hands-on physical 

activity entailed in the job. 
* ■ 

2. Job Knowledges - The knowledges or theories 
needed to perform the job function properly. 

> 3. Behaviors - Jtfb attitudes, behavioral skills 
required to get and keep'ajob.- 

4. Basic 5Mls Identifying the exact arithmetic 
skiUs,Vreading levels, and measurement skills 
required by industry for each job. - s , 

5. Equipment - Analyzing all the equipment an 

individual must manipulate on each job and the 

proficiency required. 
* 

After all tasks Were developed ("anticipated") for 
each occupation, they were given to persons in that 




occupation to determine a) whether/ft was o: wasn't a 
skill needed, b) whether the tasters an entjyd^l skill, 
and c) the frequency it was performed in a given span of 
time. The resulting data gave Ls a list of accepted tasks 
and commonalities between occupations which was the 
basis for the curriculum. This initial phase required 
131K of memory and 120 raillioru:haracters of disk to 
manipulate the data. — ^ 

The next important step was the writing of 
performance objectives for the accepted tasks, again 
baSed on industrial standards. Once that was completed, 
individualized learning packets were developed called- 
modules to teach each-skill spelle^ out in,the objective. • 
.Each module consists of at least five things: the 
performance objective, the neecl-to-kncrw data, materials 
and equipment, job steps, and a technical word list. 

" . i 

The Computer-Managed Instruction portkJlftakes 
the information gathered from the task analysis and 

* compares it with a student's competencies and 
occupational selection and provides an- individual 
learning prescription. Each student goes through a basic 
needs assessment, checking his skills in reading, 
arithmetic, and pre-employment. If a student brings 
experience or training in a given occupation, he/she is 
given a handsron test .and that result is considered in the 
development andr finalization of the leajning 

.prescription. Once the skills needed are. determined, a 
sequencing of daily and weekly schedule is provided to 
each student. It -schedules the student who has the 
severest basic skill (reading, math) deficiencies first into 
those areas and keeps track of their progress, moving a 
new student in when one has completed. 

Every Monday each student gets 'a weekly 
.schedule telling him what modules he will work on for 
thai week. It lists the sentenced modules and all related 
information so the student knows where, who, and what* 
If the student works at a faster rate than anticipated and * 
completes his ^frods" early, he merely goes to one of 
the teletype terminals located throughout the building, . - 
activates the computer by punching certain information ( 
into it, and gets an immediate update of the next 
modules to be completed. If by the end of his Friday 
period he has not completed his modules, the 
iBSpmpIetc modules appear at the top of the schedule 
for.the following Week. 



« • 

The instructor, of course, evaluates whether or 
not a student has met*the performangl standards and 
conveys the infQrmation to the computer via a system 
using an optical scanner. While evaluation is continuous, 
a Cumulative Student progress Report (CSPR) is issued 
every nine weeks. It compares the student's rate of 
quality productivity within the evaluation period with 
the total time available to .the student, which is usually 
graduation, and indicates whether he/she will or will not 
/ completejrjy*! the occupational goal)! As" part of the 
sL^Jio^^oxt 9 the instructor does a narrative evaluation 
^ which is printed on to the CSPR by the computer. 

Finally, upon graduatieln from a program, each 
student receives a certificate of .completion. It irtcludes 
an explanation to employers and a list of tasks 
student can perform land that we at the Center will StandN 
behind. *' 

As previously stated, a Univae 70/2 is used.. We 
- utilize DOS communication systems and a maximum of 
60K is needed for the operations. The memory 
requirement for management system's is 96K based on a 
unique scheduling program. The system is writteiv in 
COBOL and communications is Assembler. The Univac 
system consists of one, control processor, 13 IK, 4 disk 
devices, 30 million bytes eath, i»30KB tape drives, one 
reader, one printer, one punch, and one communications 
controller with^ight teletype lines. c> . • 
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PLAN: Program for Learning in Acco^ance with Needs 

George De Hart + 
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PLAN was developed by the American Institutes 
for* Research (AIR), under the leadership of Dr. John C. 
Flanagan, during the four year period 1966-1970. The 
priyect was to create a comprehensive program for the 
individualization of instruction in Language Arts, 
Mathematics, Science and Social Studies, K-l 2. From Its 
inception the computer was always considered a major 
management tool. AIR early saw. that the greatest value 
of the computer was irvJthe management of processes, 
rather than tutorial, in an individualized program. 
Working with 14,public school districts, AIR continually 
'redefined and implemented the computer management 
system during the developmental years., 

I- * 

Marketed commercially by Westirighouse Learning 
Corporation sitae 1970;, 'PLAN has continued to use the 
computer as att||ssentia^ component ng&jed to manage 
an individualize^ instructional profer&fn. Currently 
(November 1974), approximately 60,000 students in 64 
school districts in 24 states and one foreign country are 
using the system. The computer program has been and is 
being continually changed to reflect the needs of 
teachers and students. v 

Capable of supporting any objective-based 
curriculum, the WLC computer management system 
Currently supports*>PLAN and locally developed 
programs with the following functions: 

1. Identification and achievement level assessment 
of each student, 

2. Identification and recommendation of the 
quantity of instructional materials needed, 

3. Daily status reports of each student and 
planning sections for teachers and students, 
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4. Daily instructional objective test scoring, 

5. Daijy placement testing, 

6. Daily PLAN achievement test scoring, 

7. Periodic student progress reports, 

8. Administrative reports, 

9. Weekly summary reports, 



10. On-line student progress reports, 

1 1 . History oC§tudent progress, 

12. On-line ordering of additional materials, 

13. Development of each student's program of 
iPttfc study, 

14. Processing of* locally developed objectives^ 
4 independent activities, and coutses. 

Most of tjjrtfcomwrfer processing is done by WLC 

at Measuremer/t Rejpdfch Center in Iowa City, Iowa on 

an IBM S/370nS$7The mostjcprrimon terminal used in 

the school districts is the IBM 3735 with an IBM 295& 

Card Reader and an IBM 3288 Matrix Printer. 

• 

. ' Increasingly popular as school terminate are^the 
Minicomputers, which can provide services beyond the 
PLAN computer program. A Hewlett-Packard 2100 8K 
CP^with OMR Readers and Printers is most commonly 
used. A few schools are using their own IBM System .3. 

' ** 

Five school districts are now Messing the WLC 
PLAN software on local computers to manage both 
PLAN and local curriculums. This provides a locally 
controlled and economically, efficient service using 
committed resources. The PLAN program, written in 
ANS COBOL, Version 4, requires hardware of at least 
1 10K with 3 tape drives and 9-track dual density. 
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CMI first entered" the scene at the University of 
Kansas Medical Center several years ago, when a. general 
revision of die pre-clinical Medical Pharmacology course 
was being planned. The overall objectives of the 
curriculum revision were 1) to k permit each student to 
^select the educational approach which is found to be 
most effective for him, and 2) to enable each student fo 
progress through the ccmrse content at his own rate., 

t At the present time the pharmacology course is 
divided into five independent modules or units arid the 
material in e?a#r of these modules is available tp the 
student through a variety of scheduled (lectUresj'labs, 
discuSlon groups, clinical .conferences, etc.) and 
nonscheduled (C&I, AV, tutorials, ward rounds, etc.) 
options. In additiort, a syllabus has been prepared which 
outlines the material covered* in each module. Each 
student can utilize much of the material in each 
option as he needs to achieve his objective, which is to 
demonstrate k ct>mpetenc£ (pass an exam^ in the area 
covered in each of the five fnodules. New exams for each 
of the five % modules are provided weekly, and since there 
is no penalty associated with failure to pass an exam s the 
stud^t. is encouraged to use the exam as a "progress 
yardstick." He is aided In this evaluation by a diagnostic 
identification of weaknesses. 

c Computerized support \f Pharmacology's 
Computer-Assisted Teaching System (CATS) is* now 
being maintained by the CAI/CMI ^ectjon of the 
Department of Health Sciences Education. Three 
subsystems *have been developed to support CATS. 
These are: the KUMC Test Question System (VH 
Programs), the Exam Grading/Analysis .System (LR 
Programs), and the (?AI Systerjj (IBM Coursewriter III). 

KUMC Test Question System \ 

• • \ 

This system performs test item pool-management 
functions and generates examinations. The Department 
of Pharmacology currently has over 11^000 items in 
their pool Using this pool they are able to generate from 
3 to #8 unique examinations each of the 17 weeks that 
the course is inprogress. The test item pool is stored on 
an IBM 3330 disfJ^TCan be updated from a terminal 'or • 
in batch mode. Examinations can be generated by calling 

. specific items Qr by ^pndom selection of items within a 



category. Examinations are printed on the system"^ 
printer ready for duplication- Selector cards are retained * 
on file in the various departments for each item in the ' 
«»pooI. These cards contain the correct answer, category 
> designation, item type and item analysis data.. A. test 
report is run on a proposed test prior.to test generation 
to provide % the test coordinator with information about, 
the dtodibution of items over categories, item type and 
correct answer, and the projected level of difficulty and 4 
discrimination. This information enables him to make 
■necessary changes to" the test before the final run and 
eliminates many potential errors that are often made in 
the preparation of an examination. 

Exam Grading/AnalysisrSystem 

Students taking examinations respond on answer 
sheets tha't are read by an optical scanner (OPSC AN 17) 
and transmitted directly to disk on our IBM 370/145. A 

* series of batch programs are used to score the 
examination and provide reports to students and the 
faculty on the results. Each student receives a letter 
giving him his grade, the correct answers to the 
examination, his answers, whether his score was 
superior, satisfactory or unsatisfactcypy, evaluation* of 
performance on |he various categories covered by the 
exam, ^pd his progress to date in the course. Absent 
letters are sent to students nof taking an exam in a given . 
week to serve as a motivator. Unit chairmen within the t 
department receive several reports. These include a 
listing of th.e responses of the students who took the 
exam, item .analysis of each item used in the exam, and 

. student performance by category. The unit chairman 
also receives a report listing the status of alfstudentsin 
his unit as well as a performance analysis based on the 
highest score each student received in the unit. The test , 
Coordinator for the department receives a report of each 
student's performance during each week of the course. 
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EDUCATIONAL MANAGEMENT INFORMATION SYSTEM AND 
COMPUTERIZED INSTRUCTION SUPPORT SYSTEM 

B; WardDeutschman 
'New York Institute of Technology : 
I ■ Old Westbuty, New York 



>EMIS 

the Educational Management Information System 
(EMIS) consists of a series of sophisticated programs and 
files which can administer, monitor and record 
individual student work in subject^tter review drills 
and tests. The study and test material may be presented 
to the student either on-line or as computer-printed hard 
cO^prepafed in advance. The intention of EMIS is to 
provitife, a large number of objective questions of all 
types KHserVi*^ .criterion checks and achievement * 
indi^Sfo.'^' 

EMIS, designed by Dr. Harvey Poliacjc, is a 
combination of CAl and CMI. The EMIS^presentations 
are supportivfe and supplementary to ^.classroom 
instruction, self-paced individualized study, laboratory 
experiences, and auxiliary audiovisual aids. In the 
on-line modf, every student's response is evaluated and , 
recorded for future statistical analysis and the student ' 
receives his score immediately after completing the bank 
of questions for that topic. ^ « 

EMIS is a chained assembly of a number of 
comptfter programs and files. All of these have been 
written in extended BASIC so that they may be loaded 
into any large computer .or hiinLqp'mputer with minor 
modifications. Currently, the EMIS programs are 
running on a Xerox SIGMA 6*comiputer, operating under 
Universal Time-Sharing OperatingSystem. 

EMIS produces reports for the student, instructor, 
and curriculum designer. Each user has access to specific 
course information predetermined by the EMIS 
developers to ensure material security and test integrity. 
The reports offer: records of individual student progress, 
analysis of individual performance for remediation, 
records Of cumulative , class progress, „ analyses of 
Strengths and weaknesses in question categories, , 
cumulative item analyses, t and indications of the 
existence of trouble flags. ' 

CISS 

The Computerized Instructional Support System 
(CISS) keeps track 6f a student's progress throughouthis 
course work giving immediate correction of tests, 
remedial prescriptions if deeded, and ascribes some 

» r 



measure of rate of progress to an individual's work. The 
system also functions to collect, information on the 

. validity of testing material, and the effectiveness of the 
course material. The Automated Instructional 
Management System (AIMS), which provides 
prescriptions Jo the learner' based upon the 
accomplishment of specific objectives, is the progenitor 
of CISS and EMIS. CISS is a.group of related programs 
and files which proyides on-line correction of tests, 
issuing of remedial prescriptions, marking of attendance 
cards, generation of reports on individual student 
progress, query of-history of responses for any student, 

* and updating of test answers and student information. 
The system provides off-ljne editing and reporting of 
responses captured during on-line operations, data 
analysis of curriculum matetials, and creation, 
maintenance and backup of data files, Dr. Alan 
Rosenblum is the designer of the system. 

CISS uses a teletype-like terminal and an optical 
mark reader, acoustically coupled via telephone to a 
time-sharing computer. The system consists of three data 
files, and the'programs which access them. The data files 
♦consist of the Student Fite cohtaining identifying 
information about each studjmt, tReTest File containing 
test answers and prescriptions, and (he Response File 
which stores all transactions. The programs have heen 
written t in interactive COBOL and are running on a 
Xerox SIGMA 6, operating under" UTS. 

EMIS is used as an instruction support system for 
postsecondary teaching at the New Yotlk Institute of 
Technology, and CISS is currently utilized jin a local 
junior-senior high school to enhance English, Social 
Science, and*Mathematics instruction. 
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In 1972, the College of Dental Medicine at the 
Medical University of South Carolina embarked upon a 
program of developing a self-paced dental curriculum. 
The program included the concept that the computer 
was indeed a useful if not an essential tool in its 
development; Accordingly, following a study to 
ascertain the best method of integrating computers into 
the curriculum, plans 'were made for the acquisition of a 
time-shared minicomputer system wjiich would be used 
/ delusively to enhance the educatiorm experience of the 
dental students. 

System acquisition, a PDP-11/20 using the RSTS 
operating system, was completed by July 1973. Hie 
efforts of the staff of the newly formed Office of 
Computer Resources have . been in the areas of 
Computer-Assisted Instruction ahd Computer-Managed 
Instruction equally. While tire long range goal of a 
tQtally self-paced dental curriculumcan be met in large 

*j part by using traditional CMI techniques, • the most 
^ pressing problem for management^ the dental 

* curriculum is in the area of student-patient clinic- 
assignments. 

» 

• A dental curriculum is. similar to, a medical 
curriculum m in that the students spend approximately 
half their time studying basic sciences with lectures and 
laboratories and the other half of their time actually 
seeing patients in a clinic setting. However, unlike the 
medical curriculum where students are assigned to a 
specific clinic and may or may not see a patient with a 

■^given disease, the dertfal student must meet a list of 
clinical requirements. That is, the students must actually 
see patients with a predetermined set of conditions. This 
structure requires the dental school to assume the 
administrative chore of locating a large pool of patients 
from the population of the community and keeping a 
-fecord of the treatment needed on each of, these 
patients* Itjs an obvious extension to use the computer 
to maintain the\patieitt*files as well as«a file on every 

--student and the kiijds of -treatments that students need 
to carry out or have already carried out for purposes of 
grading. Thus the major goal of the Office of Computer 
Resources in the next two years is to complete the- 
building of the patient file, and the student file. This 
includes maintaining records, from both the student and 
patient point of view, of every treatment which is 
completed, each treatment which is in progress, and 
treatments which are yet to be done. This allows an 



up-to-the-minute progress review and grading scheme for 
the students and prevents incompletely treated patients" 
records from^ getting lost for, whatever reason. The 
system will further involve keeping track of patient 
appointments and clinic utilization. 

♦ 

. « 

The clinical assignment system described abov.e is 
presently well underway in its development. In addition, 
an extensive, didactic grading system has been developed. 
At present this grading scheme addresses course grades 
rather than modules. 
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Focus 



Comprehensive Achievement Monitoring (CAM) is 
an evaluation methodology with associated computer 
hardware and software which falls into the rubric of 
Computer-Managed Instruction (CMI). At a general level, 
evaluation methodology has as its purpose: "To provide 
information upon which a specified decision-maker is 
able to base decisions." CAM is* an evaluation 
methodology especially, designed for instructional 
situations because it is criterion-referenced, flexible, and 
computer-assisted, and provides information for 
decision-making, CMI systems are designed to proyide 
information about students'performance to'teach'ers or 
students upon which they are able to base decisions 
about future instructional activities. Therefore, CAM is 
an evaluation methodology many of wEose components 
and uses are associated with CMI. CAM will be discussed 
as an evaluation methodology below. 

* CAM has been systematically developed, from 
1967 to 1969, at the Research and Development Center 
for Teaching, Stanford University, and from 1969 to the 
present at the Center for Educational Research, 

-University of Massachusetts/Amherst. It" is 
conceptualized in 12 major steps, each of which is 

* thoroughly documented in numerous operational 
substeps^ An analogous Generalized Evaluation 
Methodology developed by Thomas E. Hutchinson and 
others~~(Hutchinson, 1972) has contributed to the 
refinement of CAM. The 12 steps include: 

Step i'. The Enterprise-ihai aspect of the instructional 
situation (such as an individual student, a group, 
or the curriculum) about which decisions are to be 
made and, therefore, about which data are to be 
collected-is defined by the person initiating the" 
evaluation. 

Step 2, The [Resources available for the evalUatioA are 
specified^ by the person initiating the evaluation. 

Step 3. The Decision-Maker, who makes decisions about 
the enterprise "and to whom data are .to be 
, reported, is identified by the person initiating the 
evaluation. (More than one decision-maker may be > 
chosen. The decision-maker may be an individual, 
a group, or a collection of people. The initiator 
may or may not be selected as the evaluate r.) 



Step 4. The Goals of the enterprise are elicited from the 
decision-maker by the evaluator but not stated by 
the evaluator. - 

Step 5. The Objectives associated with each goal are 
elicited from the decision-maker by the evaluator 
but not stated by the evaluator. 

Step 6. The Decisions to be made about each objective 
are elicited from the 'decision-maker by. the 
evaluator but not stated by the evaluator. * , 

Step 7, The Measurement Technique (or items) is 
developed by the evaluator or the decision-maker 
and is criterion-referenced-i.e., related to an 
individual objective. 

Step 8. The Design, consisting of "which measurement 
instrument to be administered to which subjects 
on what schedule," is created by the evaluator and . 
approved by the decision-maker. The design 
usually includes multiple matrix sampling. 

Step 9. The Collection of the data is carried out by 
systematic logistics procedures. 

Step 10. The Analysis of the data collected is performed 
quickly and flexibly by compute; to the 
specifications set by the evaluator and approved 
by the decision-maker. 

Step 11. The Report of the data is printed by computer 
and submitted. to the specific decision-maker for 
whom the evaluation was designed. 

i 

Step 12. The Revision of the CAM evaluation* js 
considered by the decision-maker. 

The methodology has been described in detail by 
Gorth, O'Reilly and Pinsky (1974) and in a number of 
technical reports. The CAM evaluation techniques have 
been instituted in many schools across the country, at all 
grade levels and for- many subject matters including 
special education (Gorth & Hambleton, 1973). 

Instructional Dependency 

CAM is designed to provide a specific 
decision-maker with criterion-referenced information 
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about a specific aspect of the instructional situation. 
Regardless of whether the decision-maker is a student, a 
tether, or an administrator, of whether the enterprise is 
a student, a group, or the curriculum, of whether the 
decision to be" made is concealed witl* planning, 
determining current status, or retrospective Issues, the 
evaluation begins with the r enterprise that the 
decision-maker specifies from his own perspective in 
terms of his goals and their related objectives. The 
measurement technique is written from the objectives. 
Therefore, there is always a close relationship between 
the objectives of instruction and the criterion-referenced 
measurement instrument. 

Objective and Item Generation 

The decision-maker is responsible for specifying 
his goals, objectives, and decisions (to be made) for the 
enterprise. The process may include the selection of 
objectives from the bank of objectives provided by the 
CO-OP (1972), but only after a <*t of goals and 
preliminaiy objectives have been defined, A numerical 
indexing system is assigried to the objectives. However, 
CAM could be used with existing objective-based 
programs such as IGE, IPI, IMS, and PLAN. 

The test items are generated from the objectives 
by the decision-maker, if he is a teacher, or by the 
evaluator, if the decision-maker is an administrator. A 
computer-based system for objective and item storage 
and test printing has been developed to facilitate a rapid, 
flexible, and accurate construction of numerous test 
forms from the criterion-referenced test items (Gorth, 
Allen & Grayson, 1971). * * 

Test Model and Packaging 

After the test items have been generated, the 
assignment of the items to test forms and the scheduling 
of what students.are to be Jeste4 with which test forms 
on what schedule (i.e., the design) is determined by the 
decisions the decision-maker wishes to make (O'Reilly & 
Gorth, 1972). 

*> 

The designs created" to collect data fQr each of 
these decisions may use any of several alternatives. . 
However, the multiple matrix sampling design is often 
used, wherein a set of test forms is prepared, each form 
containing a sample of items representing all the 
objectives taught in a particular portion of a course. The 
set of test forms is administered in a "time series" design 
at regular intervals, but in" such* a way that no student 
takes the same test fofrn more than once during the 



series of test administrations. The use of such a design 
for a science curriculum evaluation has, been described 
by Hambleton, Gorth & O'Reilly (1973). 

Test Scores 

Computer programs have been designed to score, 
store, retrieve, analyze, and report criterion-referenced 
information collected using multiple matrix sampling 
and a time serie^esign. The enterprise may be a 
student, a group^f students, or a large and complex 
curriculum. Reports may be selected by the 
decision-maker from a variety which are available (Gorth 
& Grayson, 1969; Gorth, Grayson & Lindeman, N 1969; 
Gorth, Grayson, Popejoy & Stroud, 1969; Gorth, 
Grayson & Stroud, 1969). 

/ 

Reports are available to produce information 
about each of the following enterprises: 

a. Student Report containing identification 
information, student's score on each objective, 
total scores*, and indication of the objectives for 
which instruction has beencompletech 

. b. Teacher Roster 'containing the students* names 
and both total score and score on objectives 
completed for all test administrations to date. 

* * 

c. Group Summary containing average scores on 

each objective or group of objectives for a portion 
of a class, all of a class, all of a building, or all of a 
district at each test administration tQ date. 

Grouping Guide containing students below 
-criterion on an objective. * 

e. PrescHption Guide containing a listing of related 
exercises for each student for each objective. 

T. Item Analysis containing difficulty indexes 
before, ^immediately after, and a delayed time 
after instruction. 

g. Curriculum Analysis containing pre-instruction, 
. po^instruction, and ration averages for . 
objectives. 

The CAM system hasbeen used in several Title HI 
projects, it is also the system providing the evaluation 
design for the New York State system called the System 
for Pupil and Program Evaluation and Development 
(SPPED), developed by Robert P. O'Reilly. 

4G 
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Cdmputer Hardware ' * 

CAM computer software was originally written for 
an IBM 360/65 computer at Stanford University and was 
considered a research system rather than one which * 
could Be implemerited by schools. More recently, -5 * * 

• adaptations of the original software have been written * * 
fpr "mini" computers such as Digital 11/45 and 

Hewlett-Packard 2000F. The smaller computers and 
their associated computer software have allowed the 
decentralization of activities, but have used the 
standardized procedures at the decentralized sites. f 

Additional information is available from William 
P. Gorth, PhD., Center for Educational Research, 
School of Education, University of Massachusetts, 

• Amherst, Massachusetts 01002 (413/545-1537). ' * 

* 
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• Mission 

* , y. 

The. primary mission of Project ABACUS is to 
procure, test and evaluate a computerized training 
system tailored to the needs of the Army. In addition, 
the Product Manager advises the Commander, U.S. Army 
Training and Doctrine Comnjand (TRADOC) on matters 
related* to computers in training, acts as consultant to 
the Department of Army Staff, participates in the 
PLATO IV Project sponsored by the "Advanced Research 
. Products Agency, serves on the ARPA Educational 
Technology Advisory Panel, and maintains liaison with 
other Department of Defense agencies and civilian 
institutions. On July 1, 1974 the Product Manager's 
Office (PMO) was additionally charged with the 
development of a Long Range Plan for TRADOC 
Training and Schools, proponency for TRADQC 
subgroups on Policy and Procedures and Tactical 
Application of Computers and the Supervisory 
Management of the Combined Arms Tactical Training 
Simulator (CATTS) at Ft. Benrjing/Georgia, 

Objectives 

Employing three Army training courses, the 
project aims to achieve the following: 

1. Cost effectiveness - through reduction in training 
time, decrease in failure rates, streamlining of 
training management, use of small-scale 
computers, and provision of a base for rapid 
expansion. 

2. Training effectiveness - by individualizing 
instruction, incorporating the best of existing 
"media and relieving the instructor of routine 
administration. 

.3. Technical efficiency through utilization of 
off-the-shelf equipment.* 

Background 

In June 1972 the Vice Chief of Staff of the Army, 
based 6n recommendations of a task^ group, approved 
Project ABACUS. This approval included the following 
stipulations: use of small-scale computers, concentration 
of expertise at a single location, use Of three training 
courses, and a maximuj| of four years duration. 

Selection of Ft. Monmouth as the jsrte for the 
management office was based on, the existence' of 
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expertise developed there during an earlier successful 
project. In that experiment, utilizing 102 houfsof basip < 
electronics, oyer 1,300 students received instruction by 
means of the computer. A summative evaluation 
comparing results' gained from students in the project 
with those of conventional classroom students showed a 
35% reduction in training time, a 21% decrease in 
attrition, an equivalent academic achievement, and a 
highly favorable attitude toward computerized training. 

Conduct of Training 

Under the Computerized Training System 
concept, instruction will be individualized from 
beginning to end. Each student will progress through a 
course at his own pace. 

To accomplish this goal, the instructional 
personnel and the computer must function as a team. 
The instructional personnel will prepare lesson materials/ 
monitor performance, supervise laboratory work, and 
provide direct assistance. The computer will maintain 
records, guide student activities and present portions of 
the instructional material. In this manner a reduction in 
overhead personnel is considered feasible. * 

V 

The need for group activity is not overlooked,, 
Lectures, demonstrations, conferences and team 
exercises will be included, as appropriate. 

Evaluation 

Evaluation of Project ABACUS will consist of two 
major elements. The first will be designed to provide 
quality assurance of course materials, while the second 
fall form the basis for recommendations for the future. 

Although both elements of the evaluation will be 
'accomplished by in-house personnel, consultants will be 
called upon from time to time to advise in specific areas 
and thus ensure validity of the findings. The final report 
m will include an analysis of the results weighed against - - 
objectives of th« project, i.e., cost effectiveness, training 
effectiveness, and technical efficiency. 

Status of Procurement 

On December 26, 1973, a contract was awarded 
by the U.S. Army Computer Systems Support and 
Evaluation Agency to GTE Sylvania Inc. for a 128 
terminal multiminicomputer system (MMS). A GTE 
Sylvania information bulletin defining the utilization of 
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the system is available. j 

A 32-temiinal display controller subsystem was 
delivered to the U.S. Army Signal School (USASIGS), 
Ft. Gordon, Georgia on July 29, 1974. Upon completion 
of the subsystem test and acceptance, it will primarily be 
used to support course material development and online 
entry utilizing available CLASS I authoring commands. 

The remainder of the system to include software 
and CLASS I language is scheduled/for- delivery by 
March 1975. Following the acceptance testing of the 
128-terminal system and the CLASS I authoring 
language course material validation and "systems 
debugging will take place. It is anticipated that the CTS 
will be operational with the first course by, August 1975. 

Course Development 

The U.S. Army Signal School Computerized 
'Training System was initially established in January 
1974 and its participation on the ABACUS Project 
consists primarily of the development ' and 
administration of ihree technical training courses oji the 
CTS provided by the Product Manager. The courses, the 
first of which is scheduled to Se operational by August 
1975, are: MOS 31E20-Field Radio Repair, MOS 
31J20-Teletxpewriter Equipment Repair, and MOS 
35L20— Avionics Communications Equipment Repair. 
Progress in course development by the task group has 
been significant. In addition to £ seminar held at Ft. 
Monmouth for course leaders, several workshops have 
been conducted for course instructors and consisted of 
„ workshops on the instructional model and teaching 
strategies, the CLASS t authoring* language commands, 
and lesson development technique^ and procedutes. 
Presently course development of the three courses is 
actively underwayl 
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A COMPUTER-BASED INSTRUCTIONAL MANAGEMENT SYSTEM - 4? 
FOR ELEMENTARY SCHOOLS 

Tse-ChiHsu 

University of Pittsburgh " 



An ideal individualized instructional system " 
usually includes four phases of activities. 1) diagnosing 
student characteristics and assessing student 
achievement, 2) storing and retrieving student data for • 
decision-making, 3) prescribing instruction according to 
students' needs, and 4) instructing students, using the 
^nost appropriate method. The computer-based 
instructional management system described here 
attempts to employ the assistance of a computer in all 
four phases of the instructional process. This computer 
assistance includes: computer-assisted testing (CAT), 
information retrieval, the instructional option display 
* (IOD), and computer-assisted instruction (CAI). 
Although the use of the computer in instruction is an 
integral part of an instructional management system, this 
component can initially be developed independently and 
implemented as an option for instruction. Therefore, the 
role of the computer in instruction will not be discussed 
here. 

In order to explore jhe possibility of using the 
-computer to administer achievement tests, a' 
computer-assisted testing Wlel was developed, this 
model was designed to genersn? and administer pre-tests, ; 
^jost-tests, curriculum-embedded tests (CETs), and \ 
exercise pages (practice problems) for all skills included 
in a unit. Based on this model, six experimental 
'programs were written for E*£evel IPI Math in 
Numeration/Place Value, Additipn/Substraction, 
Multiplication, Division, and Fractions (comparable, to 
third a»d fourth grade math). These programs were 

^ implemented during the past two years (1972-1974) to 
. study the feasibility of CAT as an alternative Yor testing, 

\ the strategy of item generation, the characteristics of 
items generated by a computer, the establishment of 
rational mastery criteria, and the impact of CAT on 
students' attitudes toward math and computer tesfing. 

To process test and instructional" data, an on-line 
information retrieval system was developed and 
implemented at the Oakleaf School beginning in the Fall 
of 1973. This system was designed to, be used by 

KB. The research reported herein was supported by a grant 
from the National Science Foundation <NSF) and by the 
Learning Research and Development Center, supported in part as 
a research and* development center by funds from the National 
Institute of Education (NIE), U.S. Department of Health, 
Education and Welfare. The author wishes to thank all past and 
-present staff of the project and other colleagues at LRDC who ^ 
have contributed to the design, development, and ; 
implementation of the management system. r-zft 



teachers, supervisory personnel, school administrators, 
curriculum developers, test constructors and researchers. 
The types of dat^ collected and maintained include. 1) 
information concerning students' backgrounds, 2) test 
results, and 3) instructional tasks prescrib^^though 
the. system wss designed for.data in various subject ireas, 
\ only math data for about 200 students from grades one 
through five were collected and stored in the data base 
during the 1973-74 academic year. During the 1974*75 
school year, two classes in kindergarten were also 
• included^ in the data t?ase> 

Trys information system can be divided into four 
majoi ^mponents. 1) data gathering and verification 
procedures used by aides to enter data using the 
Datapoirri £300 at the efld of each school day, 2) 
backup pjocedures perfonri&Wjv programmers at LRDC 
befote running the UPDATE program, 3) updating of 
temporary files into the perm'anen\data base, also done p 
by programmers usually the next day,*and 4) retrieval 
and reporting routines prepared for users. There are two 

^ typgs<ft retrieval routines, i) standard reports and 2) 
the QlJERy programs. In standard reports, the tyifesof 

x variables to be printed and the output formats 3re 
predetermined In the QUERY program, the values to be 
listed ancTthe output formats are specified by the user at 
the time the" program is run. Both types of routines are 
designed ftfr on-line retrieval through terminals. 
Preliminary reactions from teachers and researchers in 
using this system are extremely favorable. 

The instructional option display is -a new • 
adventure ju^t launched at LRDC. Programming of the 
IOD modej ' using Unit E-Division of IPL Math is 
undfrway. Field testing of this model is exjpected to 
begin in the Winter of 1975. The purpose of (he IOD is 
to display available instructional options and tq suggest a . 
sequence of learning according to the computer or 
paper-and-pencil. pre-test results. Based on this display, 
students may choose the option for study by themselves 
or with the teacher's guidance. Another purpose of this 
display is to replace hand-prepared prescription sheets in 
order to fae&itajtf the process of data entry through 
terminals. *" ^rj* 

The* computer used for developing the 
management 1 system is a DEC PDP-15, a medium-scale, 
general purpose,' multilanguage* time sharing system, 
which ii housed in a van located at the school. This 
experimental time-sharing system (ETSS) includes 32K 



words of memory, memory protection-relocation 
hardware, a 1 million word drum storage unit, three IBM 

• ;2314 equivalent disk drives, two DECTAPE drives, paper 
tape equipment, faur internal clocks, telecommunicatitfn■■ 
Equipment, and terminal "cpntroller dapatple of 
controlling 64 terminals of .which 32-are v ci^rrently 
installed. Users access this system through* remote 
termuills on a telephone dial-up basis or through 

" terminals at the computer site, which are directly wired 
to the machqitr In addition to the management system, 
ETSS also supports CAI efforts in . spelling and 

- mathematics. ' 

Although CAT, information retrieval, and IOD 
were developed independently, our plan is, to integrate 
them- into a complete computer-base^ instructional 
management system. The initial phase of integration has 
begun in the design of IOD, which will use CAT results 
or data available in the information system to select the, 
appropriate options to be displayecL'The gext step the 
integration is to develop a program for transferring CAT; 
data into the permanent data base. Another major 
concern in our future development is to ijiake the 
tnatoagement systeirni^ore geheralizable to other-siibject 
c areas, other school settings, and other computer systems. 

The implementation of the management system- 
has numerous- important implications. In addition to the 
effect on students' learning processes, a favorable 
modification of the role of teachers in the classroom can 
occur. Instead of lecturing and maintaining students'* 
records, teachers should be able to devote more time not 
Only to the piocess of 1 ' providing individual and small 
group guidance, but also to the selection of instructional 
and testing material. Another even greater impact of the 
system is related' to the "work of . eyaluators and 
researchers, ^valuators and researchers need not be 
overwhelmed by an unmanageable amount of data. 
When reasonably questions are formulated with a proper 
regard for the data maintained in the management 
system, evaluators and researchers can obtain accurate 
information an<T, answers arranged ih »a meaningful 
manner. 
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The Navy Computer-Managed Instruction system 
became operational in the Summer of 1973, in two 
courses at the Naval Air Technic^jpTraining Center, 
Memphis, following a research and development effort 
that took place over a period of six years. Additional 
cour§es N are being added zuid the system has been 
extended by means of telephone lines to the Naval 
Training Center at San Diego. A CMI terminal is being 
installed at ilus-time'at the Naval Training Center, Great 
Lakes, bufiar|e scale use of this extension of the CMI 
system is riot planned for the immediate future. To date, 
approximately 15,000 students have received at least 
one week (30 hours) in CMI learning centers, shops and 
laboratories. At any given point in time, about 1,500 
students are under instruction. 

The Navy CMI system was developed with 
computer hardware located at Memphis State University. 
At the present time, the hardware configuration includes 
as a central processing unit a Xerox Corporation SIGMA 
9 " with 256K characters internal storage, with 8 
removable disk packs with a total of two million 
characters of StoragerFour of these ,drives are dedicated 
to the CMI files. One 9-tracM00 BPI (bits per inch) 
magnetic tape drive is used fpr storage of backup files. 
Th.e input/output function is Handled by an interactive 
time-sharing terminal which consists of a cluster of three 
pieces of equipment. Initial input into the system is 
made by means* of an Optical Scanning Corporation 
OPSCAN 17. Each scanner Can handle approximately 
100 interactions of the type required per h6ur. The 
second piece of equipment is a Control Data 
Corporation ' 713*10 Conversational Display Terminal. 
The output device is a Control Data.Cprporation 713-10 
thermal printer, which has a capacity of approximately 
30 characters per second. 

The usual 'student input into the system is irr the 
form of answers to questions that are designed to 
measure the specific objectives of trie course. The 
student often is reasonably sure that he knows the 
answer to the questions involved because of the 
immediate feedback feature that is built into the 
instructional material when it is developed. So it is not 
unusual for the input into the computer to be primarily 
a matter of confirmation to the student that he has, in 
/act, achieved the competency in question, and also for 



N.B. The views expressed are those of tha writers and 
are? not necessarily concurred with by the Department of 



the purpose of making it a matter of record in the 
system?. The computer can be very specific in its 
feedback to, the student, however. In an instance in 
which the student has input answers to a 50-item test, 

. for example, specific comments and instructions can be 
given concerning any one or all of the items. As a rule, 

' the student will have more than one. module of 
instruction on which to work, so that, any delay in the 

—availability of the terminal or in the computer's response 

to his input will not result in his bging delayed in 

achieving the objectives of the next unit, of instruction. 

\ i 
* v * i - 1 «•*"- 

The terminals at all three Naval Training Centers 

(Memphis, San Diego, and <Jreat Lakes) are connected 

by telephone lines to the SIGMA 9 computer at 

Memphis State University. Other hardware 

configurations were used during the R&D project, but 

did not prove {o be as effective as the one just described. 

The primary characteristic that differentiated the earlier 

configurations" from the .present one was that they 

utilized batch processing terminals instead of the 

interactive type terminal that is being used at the present 

time. At different times, during the R&D project, the, 

\ Memphis State University- Computing Center had 

automatic data processing systems other than, the 

SIGMA 9. @ne of these was an IBM 360/40, another was 

a Xerox SIGMA 5. While some adjustment in the 

computer software was involved each time the data 

processing equipment wa,s changed, CMI did fun on all 

. thYee of the systems, the Navy has been working toward 

procurement of its own computer to support the CMI 

system since the time the system was approved as* 

operational. It is expected that. this computer hardware 

will be delivered next spring. 

The Navy CMI system is programmed in a 
standard programming language that is usable in a 
number of computers produced by different 1 
manufacturers. The primary programming language is 
COBOL-hence, the programs will run with relatively 
minor adjustments on most machines for which a 
COBOL compiler is provided. The basic CMI computer 
software package was developed for the Navy under a% 
contract with Memphis State university. Features of the 
package include, extensive test, evaluation and ' 
record-keeping capabilities, the option of presenting 
comments and,, detailed remedial material, and 
generation of optional individual reports. In addition, 
history files are maintained that allow course 
optimization through periodic analysis of student 
f-pefformance and response patterns. 
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Terminal-Oriented Interactive System 

The College of Education's current CMI system 
was developed for two purposes: to^support 
.Individualized instructibn used in corfjunc|ion With an 
undergraduate educational psychology course, and to 
provide an instructional context for research on affective 
variables. The system's development and the research 
conducted were supported primarily by the National 
Science Foundation. Only the instructional aspects will 
be discussed. 



In cooperation with the course instructors, five 
topics were identified and a *sejf-u>sttti£ tional module 
was developed for each topic^ Each of the modules 
(Computers in Education, Classroom Managei^nt, 
Statistics in the Classroom, Tests and Measurement^nd 
Cultiifal Differences) was designed to require four hours * 
of a student's time and consisted of a series of readings 
with behavioral objectives and corresponding sarriple test 
items. Most readings were selected and edited. Some 
were written locally. With reference to, Bloom's 
taxonomy, all modules included objectives at the 
knowledge and 'comprehension 'level, three included 
application level objectives, two included analysis 
objectives, and one included evaluation level objectives. 
Two parallel forms of a criterion-referenced multiple 
choice test (15 to 20 items per form) were developed for 
each module. The tests, diagnostic protocols and 
prescriptions were programmed in Coursewriter II for 
the IBM ^1500 computer. A disk-oriented data 
management System was developed to permit timely 
generation of instructors' reports. 

Following^ manual pilot test in the summer* the 
system was implemented for the fall semester of 1972. 
Materials and tests were revised between semesters and a 
summative evaluation was conducted in the spring of 
19^3. During the ,four semesters of its use, 
approximately 8,900iests were admiriistered. 

Each course instructor could select the modules to 
be used in his class, determine the sequence in which 
modules we're to be studied, the mastery criterion for 
each module, and the dates by which students were to 
complete each module. During the first class week, 
students were given a handout describing the procedures 
to be followed and discussing the effective use of 
behavioral objectives. They purchased the instructional 
modules at the University bookstore. 



When ready to take a module test, a student made 
an appointmenrby telephone for a one-half hour block' 1 
of terminal time. At the time of his first test, he was 
given a brief computer-assisted tutorial on using the 
terminal. He signed on with an assigned number, was 
shown his owrt name for purposes of confirmation, and 
was randomly assigned to one of the two parallel test 
forms. Test items were displayed on a CRT and students 
responded ^by typing the number of the selected 
alternative. No feedback was provided until the end of 
the test at which time overall score (percentage correct), 
and percentage scores on individual objectives were 
displayed. If the overall percentage was less than his 
instructor's criterion, he was required to take a retest on 
aTUbsequent day. If he did not meet criterion, the 
student was given a typewriter printout containing both 
the performance. information displayed on the CRT and 
remedial prescriptions for the objectives failed. For the 
most part, these prescriptions were assignments to reread 
specific sections of the module. Retest items were drawn 
from the alternate to the student's initial test form and 
covered only objectives failed on the initial test.. Final 
score was cumulative over the two tests. A student who 
failed to meet criterion on a retest was referred to his 
instructor for further work. 

Two levels o£ reports were generated for the 
individual instructors. Module Reports listed both the 
class average and each student's test and retest scores on 
each objective in the module. Cpurse Summary Reports 
covered all modules assigned to the instructor's class and 
listed students' current oyerall scores on each module. 
Sub*criterion scores and scores resulting from retestr 
were identified. Both reports were generated- from disk 
, files and reflected test activity up to the moment. Atlhe 
instructor's discretion, reports were either generated on 
demand via typewriter or on a periodic basis via line 
printer. . . . 

/ • 

# At the time of summative evaluation, the 
percentage of students achieving criterion (80% correct) 
on the initial module tests ranged from 36% to 80% 
(median - 69%). The percentage meeting criterion on' 
either an initial test or a retest ranged from 77% to 96% 
(median - 91%). The Alpha reliability coefficients of 
individual test forms ranged from .56 to .81 (median = 
.72). Student responses to attitude scales administered 
following each module showed substantive improvement 
from the formative evaluation and were considered to be 
satisfactory. 



. The cost of developing the five modules, criterion 
referenced tests, and support software *"was 
approximately $ J 1,500. This figure reflects 1972 salaries 
and does not include the cost of formative evaluation 
and subsequent revision. Operational costs were 
computed for the first 300 students completing four 
modules. Personnel expenses were $1,740; computer 
time charges, at $6.09 per terminal hour and $48.72 per 
hour for utility use, amounted to $5,810. 

Marie Sense Card Interactive System 

While providing satisfactory service, the system 
described is mych too expensive. Consequently, a new 
system is being developed with' the goal of reducing 
computer costs while maintaining the level pf service. 
Since linear multiple choice tests appear adequate for 
most of our needs, testing will be moved off-line. The 
student will mark "his answers to a pre-printed test on a 
mark sense card and then submit his card to a 
Hewlett-Packard optical card reader. Short FORTRAN 
programs resident in the UnivertNy's CDC 6600 
computer will identify the student, test number and 
form, score the test, - and select the appropriate 
prescription. Feedbacks the student will be printed at 
30 characters per second via a Texas Instruments Silent 
700 terminal. To reduce system time, student records 
will be dumped on tape and th 1 ^ data management 
system's files wlk be updated daily. With these 
exceptions, the procedures will remain essentially the 
same, livcomparison to the operational costs cited above 
for 300 .students studying four modules, it is anticipated 
that personnel costs would increase to approximately 
$2,200 (partially due to inflation) while computer costs 
would be reduced to approximately $1,000. These cost 
figures are presented primarily for the purpose of 
comparing- the two systems discussed. Due to the various 
ways in which cpsts can be computed, the reader is 
encouraged to exercise caution in generalizing the 
absolute dollar figures to other settings. 
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CTSS was developed in 1969, and 1970. as an 
experimental application under a joint study agreement 
between IBM, and the>Los Angeles City Unified School, 
District, It is available t'rom the district and is riow«in use 
at several places, most of them institutions of higher 
education. . . % 

This application grew out of the recognition that** 
the computer could perform an important function by 
relieving'the teacher of clerical choriswhile leaving him 
» free to make instructional decisions. It was regarded as a 
first step toward more sophisticated instructional 
applications. 

CTSS uses a ceatralized data bank of questions on 
disk storage to aid teachers in constructing tests and 
exercises. The system'also scores students' answer sheets. ' 
It operated in batch mode,*With teacher requests, tests, 
arid scoring reports transported physically between the 
teacher artd computer center. * 

Items may be classified alortg several dimensions, 
including subject matter, difficulty, and behavior 
required. They are retrieved according to classification 
criteria set by the teacher. Thus, a list of questions may 
be constructed so that contains, for example, a 
specified number of questions on each of several topics, 
with the desired mix of difficulty levels. Specific items 
may also be requested by their identification numbers. 

The items selected are listed as an "exercise," 
Which is assigned a number and remembered by the 
system. The teacher may specify jhat items be deleted oj 
added to produce a new "generation" of the exercise. 
This process may be repeated for subsequent generations 
until the exercise meets the tocher's needs. 

With each exercise, the teacher receives a list of 
the classification data for the items it contains. He may 
also receive references to two sources of published * 
material associated with each question. A summary of 
the teacher's request and the items retrieved as a 
consequence is produced as part of the exercise. 

An exercise may be pointed on reproduction 
masters when desired. Also, upoWequest, the system 
will create several "versions" of the exercise with the 
items resequenced at random on each. + 



Answers to exercises are rememberal by the 
system, so scoring keys need not be submi'ted. The 
teacher may add items of his own to be scored, and he 
may have self-constructed tests scored if he provides the 
"♦answer key. Scoring of individual questions caa be 
suppressed. The usual raw data, frequency distributions, 
summary statistics, and item response breakdown are 
provided to Jhe teacher. Questions can be assigned to 
parts of the exercise, each of which will be scored 
separately (in addition to scoring of the entire exercise). 
If scrambled versions were used, additional reports for 
each version may be obtained. 

For each item collection, there is an item statistics 
file which contains usage data for every question. The 
information contained in this file includes the number of 
times the question was selected by the system, deleted 
from an exercise by a teacher, and . suppressed from 
being scored. The file also contains data obtained from 
scoring, such *as the cumulative number of responses to 
each option arid a central tendency measure of 
discrimination indices. A program is available to test 
selected statistics against specified thresholds to obtain a 
list of those questions likely to need revision. Thresholds 
can be set for high teacher rejection rate, low average 
discrimination index, unusually heavy use of a 
distractor, and very high or low measured difficulty 
• level. t 

< 

Information °n system activity" is accumulated in 
a system statistics file. This file contains data on 25 
different kinds of activity, representing the use of- 
various functions. The information is accumulated 
simultaneously for two time periods (lqng and short). It 
is classified by item collection used and by up to twelve 
groups to which teachers may be assigned. A, printed 
'activity report by item 0 bank can be obtained at any 
time.. * * 
* f 

An assortment of additional programs is available 
for printing and* updating item banks and other system 
w files.*' 

i ' 

At least a dozen item banks are now in use by 
CTSS at variolis places, and others' are' under 
development. Other systems are also being constructed 
with CTSS as a model. 
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-But-CTSS is not the onlyjjj^of programs which 



, assists with test construction* The author is personally 
aware of over 70 jiffere^system^and there are 

probably at least twice this mfej^JdosTof them make 
use of test items in machine-readable form to print 

.questibns on demand. Many include, as does CfSS, 
computer assistance in selecting the specific questions to 
be printed. Some systems can generate a very Jarge 
number of similar questions by using random techniques 
to particularize a question "skeleton." A few involye 
computer assistance in the item selection step only, with 
the Jtems drawn manually from file cabinets and 1 the 
tests printed by conventional means. * 

There are many benefits realized by those who 
employ the computer tp aid in constructing testsj 
centralized item collections , that are shared gain all of 
the efficiencies, of scale, including the advantages of 
specialization, larger question pools, and mbreTeedback. 
Clerical work associated with preparing t$sts and 
exercises is of Course reduced, and the quality of the 
printed product is usually higher. Since tests can be 
•easily fproducyd^hen required, they need not be 
collected .afty use; in- fact, a new one can be prepared 
for each, student, to support self-paced instruction. 
, Compared to most * other uses of computers in . 
instruction, th^ost can be very low. And because U can 
assist teachers having a variety of instructional 
approaches, compoter-assi^ed test construction does not 
need to force change in long-standing^classroom behavior 
patterns-while at the same time, it can support 
improved instructional behaviors. " * « 
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% Brief Description 



A critical problem in individualized programs of. 
instruction based on a mastery performance is the need 
for different versions of unit mastery tests. Often a 
student must take an exam several times. If there are 
only two alternate forms of the exam or only a small 
ppol of questions used to form exams, then test security 
and test validity become serious problems for, the course 
program. The University of Illinois at Chicago Circle has 
a large number of entering chemistry students with 
highly varied preparation for college chemistry. They are . 
given a placement test and students who score bejerw a 
certain point are required to take a course v^hich covers 
basic concepts and skills which will enable them to 
function effectively in succeeding courses in cheihistry. 

When this course is administered by conventional 
Jectures and discussion sections, the attrition rate is 
higher than we find acceptable and their ability to 
perform at the nexHevel is not dependable. For this 
reason, Professors Kotin, iiu and Jameson developed a 
modified Keller Plan for the course. They call the new 
course Chemistry 107. 

Computer-Generated Tests * * 4 

To deal with the test problem,. Dr. Cynthia- 
Jameson developed a computer program which, using 2 
skeletons of % various forms of questions, will 
generate - on demand many tests as are needed. Some 
students have used as many as eight exams for a single 
unit, (There are 15 units in the course.) In the words of 
•the authors, "An aspect of self-paced instruction that is 
t of paramount importance is the examination system. 
The examinations must be equivalent and repeatable and 
free of security problems. A system that contains a 
limited number of questions (though the number may be 
large) tends to encourage the students to build- their £wn 
files ap'd leSarn to-anti^ate the questions; to say nothing 
about the problenT^keeping the master examination 

v fije , secUre. We solved the . problem with the 
computer-generated question concept. The questions are 
no* m erely, assembled byA computer, but actu^Jly 
generated. -Numbers in problems are randomly but 
logically generated. -Chemicals and other variables care 
similarly 'selected. In addition, tffere are even different 
ways of stating the -same problem . We have literally an 
infinite number of examinatiohs-each djfTerent from all 

% of the others. The exam, system makes .self-paced 
instruction a viable format." 



Target Audience of Learners 

The target audience is comprised of inadequately 
prepared students who need basic chemistry courses for 
theit programs. In our case these are largely inner city 
students. 

Principal Instructioh Objective 

The principal objective is mastery of basic 
chemistry concepts and skills (including some math such 
as scientific notation) which will enable the student to 
function in following course sequences. 

Plan of Use 

. Exams are generated freely for students to use in 
self-testing -and sel(-stud>. Exams are, of course, 
generated whenever a student is ready to take a unit 
mastery test. 

» « 
Hardware Configuration 

Hardware used consists of Selectric IBM terminal 
connected to IBM 370/158 by phone lines. Three 
terminals handle the course load of about 100 students. 

The system is interactive. ' ' 

Estimated cost is SlOO/month per terminal rental, 
total cost is about $1,000 per mohth. This means the 
cost is about S25 per student for the course. 
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Background 

The Computer-Managed Learhing Systerti 
Laboratory at Colorado State University has been 'in 
operation since Aprils 1969 with support from the 
Control Data Corporation and* the National Science 
Foundation. Initial project goals included: 

1. Development of a centralized multimedia, 
instructional delivery" system with all media 
^storage devices to be physically independent of 
the student stations. 

# ■ 

2. Development of an adaptive teaching strategy 
based on sound leaming£rinciples and capable 
of interacting wft/^ich student on an 
individual basis /a^well as reacting to an 
accumulation^ student performance data. 



r3. Design of a 
allowing CM! 
university comf 



[ed computer system capable of 
operation to exist with other 
users. 



D. Interactive or Batch - the'CML system operates 
in an interactive mode, although students can 
manipulate batch programs via ,a special 

^operating system. 

E. Diagnostic or Prescriptive -.the CML system 
. provides both modes of operation by keeping 

records of student activities and making use of a 
decision algorithm an d a correlation matrix 
relating varices components of the instructional 
set. 

F. Auxiliary Non-computer Equipment — includes 
an Ampex fast access video disk for video 
still-image storage, computer-controlled^ video 
tape players for 'minfrectures' and a video-scan 
converter for $tudent-generated graphics. 

G. Estimated Cost - hardware costs 50-90 cents ' 
per student-terminal hour, depending upon 
amortization period of equipment. 



A prototype, 4-student-terminal system was built 
in 1970 utilizing a variety of media devices and 
employing a teaching strategy based on a cognitive 
level/concept categorization oT instructional modules. 
The prototype system has 'been thoroughly tested foj^ 
operational 'integrity by some 90 undergraduate 
engineering anc^matfiematics students studying 12 
vector algebra concepts do the 'application' level of 
learning. Also. 300 engineering students have used the 
system for slide-rule instruction. At the present tirne, a 
second generation 70-student-terminal CMI system is in 
the design pha^* 

• > 

Specifics 

A. Target Audiences- grades K-l 6. 

* * 

B. Instructional^ Objectives to provide the 

student with a variety of learning experiences, 
including information delivery and retrieval, 
* drill £nd ' practice, tutorial, enrichment, 

examination, feedback, counsel and functional 
^support including computation and simulation. 

C. hardware Configuration currently eleven 

student terminals are connected to the 
^ University's CDC 6400 system computer. 
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COMPUTER-MANAGED INSTRUCTION AT FLORIDA STATE UNIVERSITY 

Paul F. Merrill 
Tallahassee, Florida 



The Florida State University has been involved 
with computer-assisted instruction since September 
1964. The University has utilized several^ifferent 
computer systems in gofng from research and protblwe 
applications to applications in Tegular university 
instruction. The computing system ^rrently being used 
is a Control Data Corporation 6500 with five remote job 
entry stations ard over 120 remote terminals including 
teletypes, teletype compatible cathode ray tubes and 
Tektronlcs4013 graphic terminals. 

The Center for Educational Design (CED) was 
formed as a service unit to encourage and assist the 
faculty in the systematic design and development of 
instructional materials. CED has assisted . in the 
development of over 30 courses which utilize computer 
applications and service over 6,000 students annually. 
Although a wide variety of different computer 
applications are Used in these courses, the major 
application is some, form of Computer-Managed 
Instruction (CMI). A terminal-oriented CMI approach is 
used in over ten courses in areas such as Physics, 
Communications, Programmed Instruction, Business, 
Habilitative Science, and Religion. Approximately eight 
courses in such areas as Economics, Business, Geology, 
and Psychology utilize a batch-oriented CMI approach. 

A computer program developed^t Indiana 
. University by Prosser and Jensen is used in our 
batch-oriented CMI courses. The program has been 
adapted by CED to allow the entering of parameters 
through an interactive terminal and the storage of 
regeneration decks arid student data in permanent files 
on disk. ^ 

CED has also developed a library'of FORTRAN! 
Aid Assembler Language Subroutines which serve as the 
basis of a modular terminal-oriented CMI system. The 
general nature of these subroutines makes it possible to 
develop a CMI program which meets the* specific 
requirements of a particular course with relative ease. 
^For a given course a FORTRAN driver routine i$ written 
which calls the needed subroutines from the library. 
They, in turn, correspond to the capabilities to be 
incorporated inta the CMI program. The pool of test 
items with their corresponding correct t answers, 
feedback, and statements of objectives are stored in 
sequential disk files. Since these files are separate from 
the computer prograrnsTiTft possible for a secretary with 
no programming background to enter the test items into 



the computer through an interactive terminal. CED has 
also developed a program to translate these files into the 
format required by' Prosser's batch-oriented CMI 
program and vice versa. 

The following section will list a wide variety of 
cfptions which may be incorporated into a ujiirse which 
utilizes a terminal -oriented computer-managed 
' irW ^uciig n-approach. 

1 . All students may be required to take the units in a 
specified sequence or they may select the units in 
any order from a "menu." If one set of units is 
prerequisite to another set, the "student can be 
required to complete the first set before being 
allowed to select units from the second set. 
Selection within a set may be in random order. 

2. Pre-test data obtained by computer terminal or 
machine scorable answer sheets may be input and 
stored in computer files and used to rAake 
decisions concerning which units or objectives 
within units a student may exempt. 

3. The test items selected for a given unit may be # the 
same for each student or they may be randomly 
selected from each of several sets of items within a 
unit. Items on succeeding attempts for the same 
• unit may be Selected with or without replacement 
for a given student. 

• . 

4. The feedback or diagnostic learning prescriptions 
given to the student may vary widely in type and 
amount. Feedback may be specific to a given 
response, a given question, a set of questions, a 
unit, or completed units to date. 

,5. The criteria for proceeding to another unit may be 
the same throughout the entire program or it may 
be unique for each unit or objective. The number • 
of attempts per unit may be set by the instructor, 
and the student may be retested on all objectives 
within the unit or only on those objectives which 
he failed. * * 

6. A record-keeping and report-writing facility is 
available whiih provides item analysis information 
for item revision and data on student progress 
through the course. 
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7. . The student may l>ie permitted to branch to a 
calculation, routine and then return to the test 
item from which he was branched. 



8. The student may be allowed to type in a comment 
after each test item or unit if he so desires. These 
comments may be- sorted and printed for the 
instructor's use in revising the course. 

• * 

9. A bulletin board option allows messages to be 
• displayed to all users, to students within a given 

course, or to aspecific student. 

Additional information concerning 
computer-managed instruction at Florida State 
University may be obtained by requesting any of the 
following reports. 

CED Report No, 1: The Role of a Center for Computer 
Support of Instruction within the University 

CED Report No. 2: Development of Computer-supported 
Instructional Activities for Individualized In- 
struction 

CED Report No. 3: The Use of a Modular Programming 
System Adaptable to Various Instructional Needs 

CED Report No. 4: Utilization of the Computer in 
Group Instructional Settings 

€ED Report No. 5: Critical Issues in Computer-Managed 
Instruction 
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The Montgomery County (Md.) Public Schools' 
Computer- Assisted Instruction Program has 'been in 
operation since 1968. One of the original goals of this 
program was to ascertain the role of the computer in 
• testing and in test development. County mathematics 
teachers had been writing objectives and assessment 
items, developing hierarchies and gathering reference 
materials for a projected ten-unit geometry course for 
students who had successfully completed one year of 
algebra. This geometry course was intended to be 
individualized andft to that end, was piloted in 
paper-arid-pencil form in a number of ninth and tenth 
grade classes. As' originally implemented, it was a 
logistical nightmare. The amount and disposition of 
paper involved was staggering;most of the teachers' time 
was spent in assessing test items; students were 
frustrated as they lined up to get items graded, and to 
have a concept explained or a question answered. 

An obvious solution would be a computerization 
of the assessment items so that teachers could handle the, 
instructional tasks for which they are best prepared. A 
year-long computer-managed system seemed to be a 
logical mechanism for presenting items, scoring 
responses, providing prescriptions and keeping records. 
The concern of this program was not only diagnosis, 
prescription and assessment but, in addition, the 
continuous monitoring of individual progress. The 
definition of computer-man«g:d instruction which 
evolved was the student use of remote time sharing 
computer terminals to assure trie attainment of specific 
behavioral objectives through the individualization of 
the instructional process. 

The initial use of the geometry course began in 
the 1970 summer school session at Einstein High School. 
The test items for the first five units (Introduction to 
Logics Geometry as a Mathematical System, Methods of 
Proof, Parallels and Perpendiculars, Congruence) were 
written, revised and coded for use on the IBM 1500 
system. AH instruction was off-line and did not. normally 
involve the computer although if a computer-assisted 
instruction package on a concept or skill were available, 
then that CAI module could be prescribed. The tiial use' 
of this system elicited such enthusiasm from both 
students and teachers that the CMI geometry was 
incorporated into the mathematics program for three 
classes in the fall df that year. The remaining five units 
(Similarity, Circles, Constructions and Loai, Coordinate 
Geometry Snd Areas and/or Volumes of Plane and Solid 



Figures) were coded during the next semester, making 
the entire CMI geometry curriculum available. 

Upon entering the course, a student is provided an 
overview of the first unit, a lis^Tr>objectives with a 
diagram showing the interrelarfonshipsjof the objectives 
and their sequencing. Before oeginnirig the study of a 
unit, the student could take an optional diagnostic test 
to determine which objectives he had # already mastered. 
After ascertaining his entry level, the student studied 
^clusters of related objectives keyed into several books. 
These books vary in their presentation by difficulty, 

Sophistication and vocabulary, the activities related to 
the cluster of objectives might include teacher 
presentation of a. concept, small .group student 
interaction as well as readings, questions and problems 
assigned from a student-chosen textbook. Upon 
completion of assigned work, the student interacts with 

, the terminal and receives feedback on each objective of 
the cluster. Alternate assessment items are available on 
each objective if a student did not succeed with the 
original assessment. If a student fails both the original 
and alternate assessment items on an objective, he is 
referred to his teacher for instruction or clarification. At 
the end of each unit, a test is randomly generated on the 

" predetermined culminating objectives of the unit. 

During the 1970-71 school year the program was 
validated to assure that it provided the management 
system it was intended to provide. The mathematics 
department then determined that with the support the 
program provided, they would increase the average class 
size in geometry classes auring the 1971-72 school year. 
A year-long comparative evaluation study showed that 
with the 40% larger class sizes than in conventional 
geometry classes, there was no significant difference in 
achievement. In addition, a study ^as made to 
determine the amount of individual attention teachers 
gave students in traditional classes a£* compared with 
teacher-student interaction in computer-supported 
classes. The results, based on several thousand 
observations at random predetermined times by trained 
observers in a variety of matched mathematics classes, 
showed that CAl/CMi leathers provided their students 
significantly more individuaPattention than was possible, 
in traditional classes, * 

Based upon the experiences of three years and the 
results of a number of studies, including those 
mentioned above, a xecommendation was made to the 



ERJC, 



61 



54 



Superintendent and the Hoard of Education to provide 
CMI geometry to five additional senior high schools. The 
justification for this recommendation is that some of the 
program costs can be displaced through a 40% increase 
in class size with no significant .difference in 
achievement. This recommendation, as well as several 
others, was adopted and CAI/CMI programs are being 
implemented in thirteen elementary and seven secondary 
schools during the current school year. 

For further information, contact Katherine E. 
Morgan, Director, Computer-Assisted Instruction 
Program, c/b Einstein High School, 1 1 135 Newport Mill 
RQad, Kensington, Maryland 20795. 
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The College of Medicine's Computer-Assisted 
Instruction (CAI) efforts have been concentrated in 
three major areas: 
\ 

A. CAI as a supplemental teaching tool for use in 
connection with ongoing courses in the curricula 
for medicine, nursing, and allied medical 
professions. 

B. CAI as a tool for providing continuing medical 
education fqr health professionals. 

i 

C. ^t^AI as a tool" for facilitating the independent 

stilly' concept at the curriculum level in the 
* teaching* of basic science concepts to medical 
students. 

The fruits of these efforts have b'$en shared with 
other universities and medical schools. Currently, the 
University of Virginia is linked to the College of 
Medicine system. Many other schools have implemented 
College of Medicine materials on their own systems. This 
exchange is^dow facilitated via the College of Medicine 
Relea.se Policy and, in addition, the College maintains 
one of two host computer systems linked to a 
nationwide CAI network for medical education. This 
effort is sponsored by the Lister HiJl NationalCenter for 
Biomedical Communications, National Library of 
Medicine. 

• 

Major CAI Usage Areas 

A. CAI as an additiotial teaching tool for use in 
connection with ongoing courses in the 
curriculum. 

Since 1964, The Ohio State University College of 
Medicine has been continuously reevaluating and v ' 
revising its medical education curriculum. Initial 
experience with independent study was acquired 
through the use of a two-track curriculum in Anatomy 
and independent study groups in Biochemistry. The 
College of Medicine has utilized computer-assisted 
instruction in' segments of its curriculum since 1967, 
when CAI courses in Anatomy and Biochemistry were 
written to complement the independent study effort. 
Originally . these courses were used by students as 
self-evaluation exercises. In Histology, a simulated 
laboratory experience on, the CAI terminal has replaced 
actual laboratory in organ identification. CAI courses 
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have been written in the .intervening years to accompany 
many areas of study, i.e., Musculoskeletal System, 
Physiology, Neuroanatomy, Neuromuscular 
Morphology, etc. 

Computer-assisted instruction within the School 
of Nursing is used primarily by undergraduates for 
primary learning, for review, and for optional learning 
opportunities in conjunction with established nursing 
courses. Students utilize courses such as MEDREC, 
VEINS, ORTRAC, PROSHK, MATH, PSYMED, 
UANDME, BOTTLE, AGENT, ACCESS, STRIPS and 
PACARE on a continuing basis. 

Computer-assisted instruction within the School 
of Allied Medical Professions is used as a simulated 
laboratory experience for review and self-evaluation, ami 
in the curriculum of the divisions of Medical Dietetics, 
Medical Records Administration, Occupational Therapy, 
Physical Therapy, Radiologic Technology and 
Respiratory Technology. Fourteen CAI courses are 
required for student usage in the allied curriculum. 

In addition, the College software, hardware and 
personnel have been used in the past to support CAI 
developments in this category for the colleges of 
Dentistry, Pharmacy and Optometry. The College of 
Optometry continues to utilize the College of Medicine 
CAI system while Dentistry uses main campus CAI and 
Pharmacy has its own CAI system. 

B. CAI as a tool for providing continuing education 
forljealth professionals. 

The Computer-Assisted Instruction Regional 
Education Network (CAI-REN) is a statewide network 
of CAI installations. Participation in the; network 
provides health Institutions with readily . available, 
individualized instjuctional materials for , continuing 
education, planned curricula and mservue education. 

CAI-REN utilizes telephone lines to connect 
* remote terminals to the computer at the Ohio State 
College of Medicine. This hookup, available on a 
"round-the-clock" basis, permits all shifts to^utihze the 
same mode of learning. 

The CAI-REN course library is constantly 
available .to the users. CAI-REN provides new courses on 
a regular basis. Periodic revision and updating, of 
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materials necessitates occasional removal of courses, 
which are promptly reactivated after revision. 
Audio-visuals in the form of slides, audio-tapes and 
printed materials are incorporated to provide a complete 
learning environment. 

Selected courses are approved . by Various 
professional societies for continuing education credit. 
These societies include the Ohio Osteopathic 
Association, the American Medical Association, the 
American Dietetic Association, the American 
Osteopathic Association, the State of Ohio Board of 
. Pharmacy, and the Ohio Council on Medical 
Technology. 

This membership-supported network consists of 
institutions of varying sizes representative of many 
geographic areas. Currently there are 15 participating 
institutions. 

" C. CAI as a tool for facilitating student 
self-evaluation in a medical curriculum 
independent study program in the medical basic * 
sciences. 

Work in this area has come under the auspices of 
the Independent Study Program (ISP), formerly known 
as the Pilot Medical School ,(PMS). The Ohio State 
University Pilot Medical School wa§ a research project 
investigating the effectiveness and efficiency of utilizing 
independent study for medical student education. The 
charge which confronted the Pilot Medical School was to 
design, implement and evaluate a preclerkship 
curriculum that would incorporate as its foundation 
certain educational principles and tenets of independent 
study. The ISP was formed as a result of a three-year 
grant from the U.S. Public Health Service, Division of 
Physician Manpower. The grant provided for one year of 
program development followed by two years of 
operation and evaluation. The period of the grant'was 
from June 1969 through June 1972, and the first class 
of 32 students began their medical studies under this 
independent study curriculum in July of 1970. The 
second class of 59 students hegan in July of I $71 and a 
third class of 64 students began in July of 1972. In 
1972, the ISP became a College»supported curricular 
offering thus, medical students could elect this method 
of study for all their preclerkship education. 

Th$« lecture -discussion program is a four-phase, 
three-year v ft}5 month) curriculum. The ISP is a 
nonlecture, stu.dcpt self-paced program for the basic 
science study, and is* followed by 18 months of clinical 



rotations. * \ 

The concept of independent study • meairjs 
different things to different peqple, it encompasses q 
spectrum of individual interpretation and operational 
structure. The ISP does not employ compuier-assisted 
instruction in a primary instructional rbl^.The student's 
use of the computer is for tutor ial 
"self-evaluation-hence, the self-evaluation exercises were 
designed to provide the student an opportunity to gauge 
his own progress and determine his success ut satisfying 
the objectives of the unit. 

A Tutorial Self-Evaluation (TSE) program is 
available for each instructional unit (submodule). These 
exercises, currently catalogued under the access code 
"PILOT," were designed by the faculty to test 
comprehension of the instructional objectives for each 
submodule. Items in the exercises may be constructed as 
response, true-false, multiple choice, matching or 
ranking questions. The computer encounters the student 
with a question and then immediately evaluates his 
response. Correct answers receive a .reinforcing type of 

, feedback, while wrong answers trigger corrective 
feedback and another chance to respond to the question. 
The computer will also respond to unanticipated answers 
and attempt to coach the student, through a series of 
statements, to the correct answer. Of particular note are 
the different types of computer feedback provided by 
the author for the student's answers. The computer 

. programs have also been designed to indicate to a 
student when he is not doing well on the TSE. In this 
instance, the computer will alert him to his deficiencies 
with study prescriptions. Study prescriptions may 
appear as an additional study assignment, a review of 
previously suggested materials, or a simple statement 
suggesting a faculty conference. * „ ' 

Several conditions were necessary for the ISP 
concept to even be considered. These conditions are still 
. true today: 

I. The OSU College of Medicine has a stable 
computer system which is operational 22 hours 
per day. The computer used is the IBM 370/158, 
housed in "the Hospital Computer Center. The 
computer support personnel for CAI reside in the 
Division of Computing. Services for Medical 
Education and Research. The staff has the 
experience and expertise necessary to handle CAI 
hardware and software problems, and to modify 
the coursewiitcr package to accommodate user 
needs. Expertise also exists in authoring 

64. ' 



techniques, instructional programming and course 
development. 

2. Additional expertise in strategies, design and 
usage of CAI exists within the Division of 
Research and Evaluation in Medical Education. 

Recently Completed Efforts 

Under a grant from \he Lister Hill Center, the 
College has completed a. link with a national 
telecommunications network (TYMSHARE) to make 
the College of Medicine's CAI materials available to users 
across the country. There are now 59 institutions in the 
United States using The Ohio State University College of 
Medicine CAI materials on a regular basis. Through this 
grant, 1) the University of Illinois "case" materials 
(which simulate the clinical encounter) have been loaded 
on The "'Ohio State University College of Medicine 
system for use by College personnel and network users, 
2) authors at other institutions (University of 
Washington Medical School, University of Pittsburgh and 
Dowpstate Medical School) have developed CAI 
materials on The Ohio State University College of 
Medicine system, .and 3) local users havfc had access to 
the Massachusetts General Hospital CAI materials. 

Under a grant from the Bureau of Human 
Resource Development, the College is documenting and 
packaging the ISP materials. These should be available to 
medical schools and other potential users by Fall of 
1974. 

To facilitate sharing and to allow, installation of 
quieter user terminals, all College CAI courseware has 
>been converted from 100 character to 70 character lines. 

Current Developmental Efforts 

In addition to usage described above, the College 
is currently involved in several experimental and 
developmental efforts. 

Under a grpnt from the Bureau of Human 
Resources Development, the 'College is developing 
curricuiar and test materials to-extend the ISP concept 
to the clinical years of medical training. 

Under ' a grant from the Bureau of Health 
Resources Education awarded to the. Division of Medical 
Dietetics (School of Allied Medicine Professions), 
simulated CAI case "studies of gatient encounters are 
being developed. These materials are currently busing 
utilized by medical dietetic students. 
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The CMI system developed by HumRRO is an 
outgrowth of Project IMPACT'S approach to 
modularizing instruction in a CAI context. 

Essentially, we have made provision for any 
course to be broken down into.subsets of terminal and 
enabling behavioral objectives: The largest subset is 
called a Division (D), the smallest a "Module of 
instruction." A module may be thought of as a single 
concept and involves a Telling Section (T) in which the 
"student is given the concept, a Practice Section (?) in 
which the student has hands-on experience in using or 
applying the concept, and finally, a Quiz Section (Q) 
that tests the degree of mastery by the student of the 
terminal objectives set forth for that module. Any or all 
of the sections can be administered on- or off-line. In 
our CMI version, Q°remained on-line. (As applied to the 
COBOL 2 colirse developed at HumRRO, a module was 
completed, on the average, in approximately 15 
minutes.) T and P sections were converted to hardcopy 
programmed instruction. This process was greatly 
simplified because the instructional module text, stored 
separately from instructional logic, .could be directly 
printed out in a paged'and readable format. In the CAI 
version, movement among, these sections was 
accomplished via computer access and monitoring, 
whereas under CMI the student did this on his own and 
no record was made of sud\movement. In the COBOL 2 
course, divisions formed a linear (complete) order, that 
is, students completed them in a fixed sequence. (This „ 
need not be the case with other courses of mstruc.tion 
where careful task analysis has shown that certain 
divisions Can be achieved independent of the 
achievement objectives in other divisions.) Within each 
division of the course, modules form a partial order (a 
graph, a map) on which students or system could 
progressively impose a particular Jinear sequence or 
route. 

■ • 

The hardware configuration is a 360-370/145 
(OS) driving Sanders CRT'? an'd auxiliary projection 
devices. A 35mm hand-controlled Viewlex, a student 
reference manual and a glossary notebook replaced thfcir 
on line counterparts in our^ CMI mode. The learning 
environment is Interactive. Diagnosis jp our instructional 
application was based on achievement of objectives in a 
given module (or in some cases, sections of a module). 
Our software is capable of considering performance over 
a range of modules by simply adding the desired criteria 
from the appropriate objectives. The on-line Prescriptive 



aspect of our course management, viz., the individual 
student progress, is accomplished interactively through 
interface (Underhill & Stelzer, 1972). IDES-2 (Willis & 
Stelzer, 1972) is a set of batch programs for monitoring 
and managing student and course performance. 

IDES-2 has an advanced report generation facility 
that provides information for evaluating the 
instructibnal v material and student progress. In addition* 
IDES-2 provides attendance reports, lists of student* and 
proctor comments and opinions, and lists of 
informational requests made by students. Some IDES-2 
reports are used by authors tcstandardize the labeling of 
instructional material and the assignment of error codes 
to student responses, Other IDES-2 reports summarize 
student performance, provide data*on the adequacy of 
instructional components, and display cumulative data 
• on students* paths through the instructional material. 
Some reports are provided daily and others are provided 
on demand only. 

For administrative reasons, IMPACT students.are 
tun in groups. The reports generated by IDES are 
group-oriented and can be classified as being intended 
for administrative or authoring purposes, The 
administrative report and some authoring reports are 
generated on a daily basis. Other^authoripg teports are 
generated periodically, either on demand or after all' 
students in a group hayecompleted a course module. 

# 

A brief description of the daily Reports generated 
. by IDES-2 is provided in Figure 1. With the exceptiiPBf 
the attendance* report, alt daily reporti are' intended 
primarily to be authoring aids. The student comment 
* and proctbr comment reports are useful in gauging 
student problems with the instructional material. The 
glossary report can bring to light confusion In 
terminology ^That .may - be , developing because of 
incomplete instructional material/The labe ? I report is 
intended to be used to clear up any inconsistencies in 
the author's labeling of the instructional, material, The 
response analysis verification report is intended to be 
used to. ensure that response error codes are being 
assigned properly. Finally, the daily module acceptance 
, analysis report provides data that, are usecM^^Sjjhsh 
the adequacy of modules in terms o^^.pass/fait 
percentage. These data are us^d to accept or reject a 
module, thereby indicating where more authoring 
activityjs required. 

Go 



Report Name 
Attendance 



Student 
Comment 

Proctor 
Comment 

Glossary 
Label 



Response 

Analysis 

Verification 

Module 



Report Contents 

A list of all students in the group encountered on a'given day showing 
the total amount of time each student has been on the course, as well as 
indicating each student's. - overall progressr For students in the 
group-but not receiving instruction on the reporting day-an absence is 
indicated showing the total number of absences. 

A list of all student comments for the particular day indicating when 
and where the comment was made and by whom. , 

A list of all proctor comments for the particular day indicating when 
and where the comment was made and by whom. 

A list of all found, not found, and illegal glossary requests, indicating 
where the request was made and by whom. 

A list of Coursewriter labels that are apparently inconsistent with 
IMPACT coding conventions that have been encountered during the 
reporting day. 

A daily report that shows for each question encountered on that day 
the number of correct and incorrect responses. The types of errors 
assigned to the errors are also listed. 

For each module encountered on the reporting day, data describing the 
pass/fail percentage on the quiz as well as an acceptance/rejection 
analysis. 



Figure L GENERAL DESCRIPTION QF THE CONTENTS OF IDES-2 DAILY REPORTS 
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SUMMARY OF CMI ACTIVITIES AT STONY BROOK 
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Marty of the computer-based courses anfl^coursoj 
components developed at' SUNY, Stony BroSk' werj 
designed to operate in cither CMI or "mainline" CA! 
• modes, or a combination'^ both. The following J>rief 
descriptions should serve as examples of these programs, 



Essentials of Mathematics 



A computer-based student laboratory, desigft^dao 
.improve the» k basic mathematical skills of University, 
ttffresjinjen who lack themJ^Eurrently being offered at 
Steritf Brook. » > WM 

^ # \The Essentials of'. Mathematics CAI course 
incrodes-'irl its de;ign a testing ^procedure so that- the 
well-informed stutJgjH, able to demonstrate cpmpetence 
; ■Jffiltffe, topi^s^sees the program as simply a set of^gsts. 

For Rfeei^tudentt ; rome*t>r aH *>f the lessons* contain 
instructional modules, fthhougfr the lessons fcurrently on 
^^^i^^^ 1 ^ for °^ ine instr^lfenal modules, 
^ ^tansWnm^^s ihgltfdt off-li»e*nAdules as well. 



Note that/the drill module itself is of variable 
length {i.e., toeing takes place within the module, with 
/ - the nufoiber and type of drilf items dynamically 
T v dete^rnjried). The test items and the instructions and 
drill . Kerns are all computer-generated. The weekly 
H student progress reports issued to instructors are part of 
• ^the'systertf,^ 1 

* - %" ' ''4 * 
^ Ehgmh Composition 0 

P6r |he passive years at Stony Brook, we have 
^gjoyiclecj a lat^tor|gjfor those students who need, 
T reinitiation ijr some of the basic writing skills. The 
-Objectives are: 

1 * 38 . to prpvide drill afjjJ practice, as necessary for each 
" * ^ ii^iyjdua^student, in the elimination of common 
9 t ' tyntafctigal faults; A K 





DRILL 




MODULE 










2. "to give the stujjem »a*\ense* of the structure of 
' English - ' sentences, * the. function of different 
syntactic structures witlim ,t}$ sentence, and the 
way these syntactic structures WQrk^together to 

* communicate information and create siyle; 

to enable the%$tudent to attalrf mastery of stylistic 
alternatives; s * * ? « 

4;. to develop an understanding of the logical use of 

♦ -'subjDrdinators, , coordinalors, and other 
♦connectors; and „ 



5. to.KieyeJop the skills involved in self-editing of 
^*rit ten productions. 

^ \ The approach is structural and inductive rather 
x V ^ Tfiarf traiiitional or deductive. Definitions and rules are 
^k^^^Sl emphasized, >fhe student sees many examples of 
K ea ^ <??ncef|t^fich4nga^ in constant activity related to 




.Figure L SAMPLE LESSON 



^^%J^J^\i allowed to discover his own "rules/ 1 those 
which help.hftp make language work for him. 

TEach concept ^preceded by a pre-test; if the 
student demonstrates, mastery, he skips the exercises 
cohnlcted with that copcept and proceeds to the next 
pre-test. During. pfte semester, we experimented with a 
<set of exercises in programmed workbook form 
following one of the pre-tests. The workbooks were 
generated* using the textual' material and computer 
program which generated the on-line exercises. The 



feedback was, of necessity, not* as complex, but the 
format was similar. Half of the students received their 
drill and practice for this concept on-line-the other half 
.Were given the workbook and returned tp the.terminal 

• upon completion of the exercises. The purpose of this 

* experiment was to determine if these composition 
lessons would produce equivalent results if given asCMI v 
lessons rather than "mainline" CAL Should the entire 

' i series be given in CMI form, each on-line pre-test would 
be followed by either the next pre-test, or by directions* 
as to which workbook must be completed before 
proceeding. Results of the experiment are not yet 
available. \ * 

Statistics Lab 

] p This one-semester computerised homework 
review laboratory has been offered to undergraduate 
students in Psychology and Economics Statistics courses. 
Students use workbooks which contain, for each 
chapter, an introductory exposition (independent of*any 
textbook) and a set of exercises (problem statements 
only). . , 

o 

The student reports weekly to the computer-based 
lab after having.Worked out the exercises for a Chapter^ 
The lesson at the terminal requires that the student 
answer each of the problems previously assigned in the 
workbook, and only when the student does not answer x 
, correctly doeS a tutorial-type exchange 'take place. At 
the end of each' lesson {chapter), additional exercises are . 
assigned in each' -of the to'pics in o which the program 
detected, th^t thfe strident experienced difficulties. Other 
additional exercises, not in the workbook, are given 
^on-line." > ' ' • . 



THE AIR FORCE ADVANCED INSTRUCTIONAL SYSTEM (AIS) 

_ Joseph Y. Yasutake 
Lowry c Air Force Base, Colorado ♦ 
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System^Description 



0 



The AIS is a prototype computer-based multimedia system for the administration and mana^ment of 
individualized technical training on a laige scale. The primary function of the AIS is to provide training and management 
for up to 2,100 students per day in fouF selected courses.ciirrentl> being taught at the Lowry Techm^al Trammg Center in 
Dejiver, Colorado. A secondary function of AIS is to serve as an R&D facility for the Air Force to evaluate the cost and 
training effectless of instructional innovations. The AIS is being developed through contract ^vith McDonnell Douglas 
Corporation (MDC) The contract is for approximately 10 million dollars, incrementally funded over a four-year period 
, (RockWayA Yasutake, 1974). " • 




The four cpurses chosen for initial implementation are shown below together with a projected mix of 
instructional media. \ 



Inventory Management (7 weeks)/MaieriaIs Facilities (6 weeks) 

SuppIy-orientcd/Warchouse operatipns 
L Low-MedhiQi aptitude * ^ 

Precision Measuring Equipment (30 weeks) , 

Calibration of test equipment, troubleshooting 
Y tfigh aptitude 

' Weapons Mechanic (14 weeks) * 
» * 

Flight Une-team-oricntcd training * * y 



~» Medium aptitude 



\ 



IM/MF Projected Media Mix 
Printed 65% 
. ' A/V 22% 
CAI 13% 

PME Projected Media Mix 
Printed 52% 
A/V 26% . 
CAI - 22% 

WM Projected Media Mix 
Printed 54% 
A/V *36% 
CAI 10% 



^ . ' The first iteration of materials is being deveJopedJn.a single tra^k, media overlap, self^aced mode. Multiple tracks 
wilf be developed duYing the second aeration. At leaft a 25 percent sayings in training time must" be remonstrated witTi 
equaljor better performance, i * * 

Adaptive Models^AMs) " . \ 



The AMs within the system are currently under development and will provide the mechanism whidi, when based 
on student characteristics and available instructional strategies and resources, attempts to optimise the effiuen^y of, 
trairjing. ^ t y ; . r \ m ' , 

CMI Capabilities j \ # * -V* , ' . , s 

!* the v jntroduction of 'CM ^capabilities in the AIS program will be. iterative, as. Jhe. instructional materials and 
sirategics'and computer support become, available, according to the following schedule: * ' v . 



INITIAL £Janua*y/75} , 
•Test Scoring " \ k ' - 

Student Data Files t> ' 
Data Colicction\anfl Analysis, ; 
Limited Reports \ ' , 
Student Enrollment 
Real-Time Interaction at "B ,% Terminal 



V 



INTERIM (Junc/75) 
Initial plus: T « * . 

First Iteration AM 

- Resource Allocation 

- Module Assignment, 

- Student Prescription 

- Remedial Assignments 
Extended Reports * 
Real-Time Interaction at "A" 

and "B" Terminals 



?0 



LONG TERM (January/76) 
ntcrimplus: 



* Refinement of AM 9 

- Adaptive Testing 

^ Incentive Management 

- Student Prescription. 

- Course Completion Prediction 

- Remedial Assignments 
Full Reports ' 

Task Inventory 

Course Conversion " . 

Field Foliow-Up Evaluation 

4 



V 



'Computer Hardware 




The following information summariz^the planned harS^^^figuratibn for the AIS program.- ■ 

- Central Site Computed CYBER 73^44 • \^ . " 

f - Type A Terminal^ (2< luS): Interactive graphic temiiirah for use in CAJ and CMI functions 

Modified PLATO IV terminals) 
Type B Terminals (-^6). Management ferminals consisting of OMR 6$00 (5 lines per second), 
\ DI 240 - line Winter (180 lines per minute); 
\ PDP-11/05 contjgjler 



Computer Software 



The software elements of the AIS program are as follows: 



CAMIL (Computer-Assisted/Managed Instructional Language). A high level language to provide 
- -GMI/CAI capabilities for*the AIS 

- Operating System: Modified .SCOPE 3.4.2 . * v ' . •» 

- Information Management System "/ . 6 

Applications Programs • % - 
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Program Status 

Approximately five weeks of litoructiori are implemented in a sfrigl^track self-paced mode in tKe IM/MF course. 
Approximately six wefcks of self-paced materials are in tryout stage in each: of the other two courses. Initial CMI will be 
implemented In the IM/MF course in JanuaiVof 1975. The first iteration of the Adaptive Model will be* ready in June 
1976. 

0 
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Hurriedly marked responses to five preplanned evaluative questions at the close of a two-day conference is 
probably not the most sophisticated wa& to collect appraisal information. II does, however, have the advantage of being 
both an .inexpensive and immediate source of data* 

In Figure 3 we have shown the responses of 37 Conference participants to each of five simple questions regarding 
their reactions to the two-day conference. We can only presume that eigjit non-responding participants had to catch an 
early flight and could not contribute to the evaluation* We hope their^sensibilities were not so greatly offended as to 
induce an early departure The one-page questionnaires were intended to be anonymous, but four participants insisted on 
signing their names. 

Clearly, the participants were enthusiastic about the value of the Conference to themselves, with 49 percent 
checking the "very worthwhile" option. No one thought ff^as "useless." Although it would be a njistake to attribute 
attitudes toward the future of CMI to this Conference, it is interesting that almost all of the participants thought that the 
applications of CMI during the next ten yeard would be "expanding." 

^ This Conference had two major goals: 1) exchange of ideas and concepts about computer-managed instruction 
among program developers, and 2) formulation of policy recomftiendatipns which would enhance the orderly development 
of CMI. Question No. 3 deals with the first objective and shows that 23 of the 37 respondents felt that there had been a 
"great exchangf" of fnformation Or something close to it during the two-day gieeting. We believe the first goal was 
achieved satisfactorily . To achieve the second goal, participants were asked during the last late morning session to disperse 
themselves into seven groups of six persons each. The task set before each of the seven groups was to consider ten policy 
questions jn the light of what had been learned about tMI at the Conference, and to formulate several important policy 
propositions concerning the applications of CMI in education and training. Upon completion of the task in the small group 
sessions, the total Conference reassembled to receive and discuss the policy recommendations. Although the groups of 44 
Conference participants had been eating and working together .for almost two days, it was clear that an insufficient 
amount of time had been alTowed for the policy discussions. There was not enough tune to develop a consensus among the 
group about the appropriate level of specificity for a statement of policy. The recorded discussion on CMI policy matters 
was not very fruitful. However-each participant was polled by mail within a week following the Conference and asked to. 
give his or her reactions and recommendations on CMI development policy. A.total of 23 participants responded to this 
invitation with a.total of 104 separate identifiable comments. In the section which follows, the editor has attempted to sift 
and merge'the policy ideas presented by the participants. Quotes are included from tune to tune which seem particularly 
cogent. 



Question 

1. On the" following scale, please evaluate' the 
usefulness of {his conference to you: 

*2. Please judge the amount of new information 
• disseminated at this conference: \ 

4 • 

3. Please 'evaluate the exchange of ideas and concepts 
among participants at this conference: 



4. After attending this conference; how do you view 
the applications of CMI during the next ten ycats: 



Response 

<0)\ (M (6)} (12)\ (18)^ 

useless e very 

worthwhile 

<0) \ @j ggjj (12)5 

very Urge * ' 

little amount 

«i m m i m \ gg? 

little great 

exchange > exchange 

m m gaj ass 

decreasing * expanding 



Mean 
Rating 

4.27 . 



4.08 



3.78 



4.32 



5. Please indicate your feelings of the appropriateness 
♦of the expenditure of federal funds for small 
conforcnccs of this type* involving highly 
knowledgeable participants: 1 



(0) \< (0)} (0)] (W4 (26)S 
in appro- ' very 
priatc / appro- 
priate 



4.70 



Figure 3. RESPONSE FREQUENCIES FORflVE FIVE-CHOICE CONFERENCE EVALUATION QUESTIONS 

' N=<37 
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SUMMARY OF PARTICIPANTS' POST^CONFERENCE COMMENTS 65 

On CMI Conferences 

Five paiticipants- commented favorabl> about conferences as a method of disseminating information about CMI. 

"I believe a separate conference devoted to CMI should be held approximately every two years to 
convey ideas and information among the people interested in CMI. Jerry Lippey has done this with 
regard to computer-assisted test construction and the conference grew from 30 people in 1972 to 300 in 
L974. I believe these conferences serve a very useful function. However, they tend to get too big 
eventually and one loses track of much of the detail. Therefore, the larger conferences need to get split 
by topi: among developers, users, implementers and so forth. My own suggestion would be to keep the 
first two or three of these conferences limited to about 40 people and encouragelnteraction much in the 
'way this last Conference was held" . ■ v 

"Sponsor periodical conferences such as that held in Chicago, November 6-8, 1974. There appears to be 
a sufficient number of conferences or symposia (through such organizations as the AERA and the APA) • 
to discuss the more, theoretical issues involved in CMI ancTC^L Thus far, however, there seems to be 
much less emphasis on an exchange of ideas between those involved in-the implementation of CMI in 
ongoing education and training." 

"Almost the first thing that needs to be done is a massive campaign to educate educators in the meaning 
and potential of CMI. This can be done through a series of possibly government-sponsored workshops at 
professional societies, survey and tutorial articles in magazines which are read by educators, and 
introduction of computer courses into education curricula to make CMI a well known and understood / 
subject. 1 * » 

"We alsoahink that conferences such as the one you chaired should be continuous. A modification for 
future conferen ; ce$ might be that author's content should be a definite part of such conferences. Without 
the content the systems remain useless and there are many problems encountered both m the system and 
iri content development which need to be shared and encountered by both. Time for more interaction is 
also needed in order to fully benefit from othefs^ input." v 

• . 7 • * 

"An expanded conference and/or special sessions of professional meetings (i.e., ADCIS or, EDUCOM) 
should be convened to present carefully reviewed presentations and/or papers on£MI. Hopefully , out of 
thi5~3bnfercmce would evolve continuing special interest groups (formal or informal) involved with CMI. 
Clearly, one of the immediate problems in maximizing the contribution of CM 1 4S to make individuals # 
aware of the existing CMI, to pyvent the reinvention of the wheel and to facilitate extrapolation of 
existing systems to new environments and new applications." 



On increasing the Acceptability of CMI 



ERIC 



\Nine participants rn^de cogent statements related to ways that would, in their opinion, increase the acceptability 
of CMI applications in institutions concerned with education and training. . 

• _ . * . * • 

". . .the state of the art in CMI is such that it is ready for much wider application than is now, the case. It 
also seems clear that it is in the interest of federal, state, and.local governments, as well a?in the interest 
of industry, to extend the applications o$CMI"\ : - * 

"CMI should begin concentrating on the growing population of vocational and continuing education 

aduit students. Two of the more outstanding presc^kj^psVat the Conference told of work with these 
L types of students. CMI was able to overcome trdB Brself-pacing problems in an impressive manner. 

The public schools, on the other hand, have an^eraburtdance of teachers, few travel problems, and 
.dwindling numbers of students which will probably create a hostile environment for innovative CMI 

technology/* . < * f% 

• 74 
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"Effort/should be made through whatever'means possible to establish experimental test situations for 
implementation of a CMI system in an enviforiment other than that for which it was developed. This 
testing or extrapolation of CMI systems shoultfprovide valuable distribution and sharing experience as 
well as provide good research data on the benefits and application of the CMI system as transplanted. 
This idea is still somewhat vague'in my mind, but holds potential particularly in these days.of where 
declining budgets dictate the need for careful analysis of existing systems before the development of new 
ones." " / t , 

"The following, actions can be taken by universities to promote the development &f CMI systems. a)T 
offering courses related to CMI, b) incorporating basic computer knowledge courses in teacher training 
programs, c) encouraging instructors of courses to employ the CM! approach, and d) modifying 
regulations which rfiay handicap instructors' participation in developmental activities and students* 
enrollment in courses managed by computers." 



ties^s 




". . .there was a great deal more variability in the extent to which* various CMI systems have been 
accepted by and successful in their respective institutions than can be accounted for simply by the 
quality of the systems themselves. For lack of a better word, political considerations appear to be a 
much grearer factor in determining acceptanc**than does system sophistication. It may well be that the 
field would benefit from an intensive study of those factors which inhibit or facilitate CMI success m 
different settings." 

"Limited research must be continued with projects that meet specified criteria in selected areas of 
educational technology. Enough money must be allocated to insure success or failure. Three-year 
funding or less is not going to yield answers." 

«• 

"My rec&mmendations involve action at the federal level that neejls to be taken if the contributions of 
^"CMI are to be maximized in the next decade. Thjs does not, of course, preclude the involvement bf 
agencies and organizations at the state and local level but does support the concept that the higher the 
level of action the.greater the national impact." 

!*Jt s^ ms t0 me that CMI as we khow it today is perfectly [sic} technically feasible on a variety of 
* equipment, both large and small; therefore, the most pressing issues in CMI are not technical ones, but 
. father issues of acceptance and utilization by large numbers of peopled 

"Provide funding support for' the development of CMI systems. Guidelines should be established to 
delineate the characteristics of CMI systems that should be incorporated into the development projects. 
Proposals should be elicited that place an emphasis on development of CMI systems that, a) effectively 
support the instructional process, b) efficiently and reliably perform the tasks they are designed to do, c) 
support a'wide range of subjects and instructional modes, d) are not hardware or software dependent, 
and e) are transparent to the user." * 



On the Need for Model Demonstrations of CMI Systems 

Six comments by the Conference participants emphasized the efficacy of models and demonstration sites for 
advancing CMI applications: ""'****n* 

* 

"I think it is important that a CMI demonstration site be established. The site must have a service 
function for a variety ofotudent populations. It also must have a development and research function for 
courseware, software afid hardware dimensions of CMI. The site might pai&bly work in conjunction 
with a CAI installation." * * * 

• 1 

"Several demonstration projects in CMI should be funded. These should not tKlude development of new 
hardware and should not be on a grand scale! Such systems should be held tested in a variety of 
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locations, and the experiences and costs of required elements, such as training of teachers and suitability 
of equipment, should be documented." 

''"A demonstration school with opportunities for experienced and student teachers to teach in these 
situations would provide a core of experts who could return to their own school districts to design and 
implement local demonstrations ." 

"Major demonstrations should be conducted in an engineering manner. The field setting is the real 
developmental laboratory. While some research needs to be maintained, at least two major 
developmental-demonstrations should be mounted in educational technology, with the design to includ/ 
increasing ^oductivity in education. CM I needs a major demonstration effort as CAI has had." 

"Problems-orj^ed research must be conducted on specific needs that come from demonstrations, I : 
should ^ot>t the role of the demonstrate^ to solv* research problems. However, it is a suitable role fo 
the demonstrator to identify specific problem areas that need research answers." 

"There are some CMI projects already in existence which could be smoothed into model projects, or new 
model CMI projects could be conceived, funded, and made available for demonstration. This should 
cover the spectru^ of application as to grade level, economic level, and type of educational institution, 
and should be broadly based relative to hardware and software. That is to say a variety of rflanufactures 
in sizes of main frames and styles of operating systems should be used." ^ 

On Establishing a CMI Information Clearing House 

About one-quarter of the participants recommend establishment of a CMI clearinghouse that would facilitate the 
exchange of information and program materials. Some representative corpments follow. \ 

"Establish a clearing house which provides catalog-type listings an^ descriptions of subject matter which 
has been self-paced or individualized in»a manner amenable to CMI. It still appears that those involved in 
implementing CMI projects spend a significant amount of effort in developing instructional materials. If 
materials which have already been developed couldbe exchanged, it would allow those interested m'CMI 
per.se to expand their efforts on more CMI-related issues rather than in developing teachfng materials," 

"Establish a clearing house for dissemination of information on various CMI projects (i.e., public 
schools, universities, military and industry). There are many very worthwhile projects going on 
throughout the country which are not well publicized. It would be very beneficial to have some 
mechanism, for exchanging information with those involved in various kinds of CMI projects." 

* 

"Funds should be made available to set up a communications network where all items funded by 
government remain in the public domain and can be accessed by interested parties. Transfer funds for, 
initial start-up should be available." ♦ 

"To summarize*, I believe the biggest problem facing CMI at the current point in time is that of 
•communication among the various interested people so we can get some idea of the structure and scope • 
of the field and at the same time try to pull out the various theoretical frameworks that sit underneath* 
these endeavors. Most of the people at the Conference were essentially impleitionters rather than 
theorizers. However, at some point in time we need to have enough information to sit back and ask the 
question what are we really doing in CMI? Such £n f pen communication network would greatly 
facilitate this effort." . 

"There should be some formalized mechanism for collecting and exchanging information about CMI 
installations. The forms described above could be collected by some central" agency sucK as Penn Staur or 
NIE <5r somebody else and distributed yearly as a package or individually upon request especiitffy to 
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those people having submitted forms- they should automatically get the complete set. These formal 
mechanisms take very little effort and yet can serve a very good function within the field. It means a 
little bit of clerical labor for some people, but I think there are thpse willing to do that in exchange for a 
certain amount of glory." 

* 

"Set up a clearing house (at the federal level) for machine readable test item banks to minimize 
duplication of efforts in developing item banks." 

r 

"Some means must be found (I hate to suggest another central clearing house) to disseminate 
information relating to well conceived, reliable, operating, available, economical, transportable, etc., CMI 
progra/fts." 

"A clearing house for ^collection and dissemination of information and materials concerned with CMI 
should be established. This could be similar to the. organization established by the National Library of 
Medicine to take care of audio-visual materials. It was demonstrated at this CMI Conference, that there is 
much being done in CMI around the country, but not much sharing going on." 1 

On Clearing Up the Definition of CMI 

Several of the participants commented vigorously on the need for nomenclatures and descriptive conventions for 
use in connection with CMI operations. In their comments, none of (he participants referred to the pre-Conference 
documents (p. 1) which proposed three distinct levels of sophistication in CMI systems. Either they had not read the 
advance material or th$y did not consider the attempted classification scheme to be relevant. The most interesting 

.comments on this topic are as follows: ' ' > . 

j 

"Much of the CMI work reported at the Conference in Chicago was very closely akin to CAI. I think it is 
important that we recognize that CMI arches the entire range from individualized testing and 
prescription to the management of the instructional system of a complete institution." 

"Initiate an effort to define and categorize different levels of CMI (e.g., on-line vs.l>atch processing). 
x There is still a lack of standardized definitions of CMI. Some systems appear to be qune sophisticated in 

their CMI approaches (e.g., on-line testing and student prescriptions). Others appear to depend on 
overnight batch processing of student progress data. Botti categories are called CMI. There needs to be a 
clearer definition and categorization of these functions and levels of CMI so that everyone is talking 
about the same thing." 

"Clear specifications should be made by educators of what a CMI system is. The purpose of these 
specifications is not intended to limit individual developments. It is intended to provide helpful 

guidelines for those interested in developing a CMI system. The specifications should provide the- — 

following information, a) the roles of instructors, computer, instructional and testing material in a CMI 
system, b) how instructional and testing material should be developed to fit into a CMI system, and c) 
the software and hardware required to implement such a system." 

"I believe suggestions and recommendations proved difficult because we lacked a clear definition or 
definitions of CMI. j4ie presentations described projects from a limited, retrieval system to rather 
sophisticated CAI projects. So first, I would suggest clear definitive guidelines be established so we are 
not comparing apples to oranges. This probably means we need more categories than CM! and CAI. 
Perhaps we could define by functions, rather than such broad general terms!" 

"Develop a taxonomy to classify and compare CMI systems which emphasizes the decisions for which 
data are provide'd and which minimizes.the report rormat for hardware and software characteristics." ' 
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"Develop a suggested nomenclature for CMI concepts which includes concepts in the instructional, 
^ software, and management domains." ^ ^ * 
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"Sponsor studies to define the role of teachers, instructors and aides within a CMI environment. Much of 
the current emphasis in CMI is focused on management of students without a real look at the role of the 
instructor in this new environment. This is a very critical area. There needs to be a much more thorough 
and systematic effort to define^the role of teachers and training managers and to come up with 
suggestions regarding such areas as selection and. training of such people." 

"Arrange for an impact study with analysis of impact on jobs, nature of work situation, changes for 
teachers, changes in relationships to the educational process on the part of the students, related family, 
public leaders, etc." 

"There should be developed a standard form for describing CMI systems using a consistent set of 
.characteristics that deal with the curriculum plan, the instructional model, the management philosophy, 
and the use of the computer as a major set of headings. We could make a pass through the known 
systems from the Conference with such a form and use them as the debug tool to develop a good one. 
Subsequently, we could mail these out to the people responding to the inquiries mentioned above and 
have them filled out and collected at a central point for dissemination. Perhaps they could even be 
inserted into ERIC or something along these lines. I think such, a data collection mechanism would be 
extfemely helpful for fields which are as fluid as CMI is. Periodic follow-ups could also be conducted to 
find out how many systems have died over a given peritSd of time." 

On the Importance of Theory in CMI 

c 

% 

Many of the participants in their comments referred to the need for a theoretical undergirding of CMI systems. 
Four of the most explicit comments are as follows: 

"Development is needed bf instructional -theories that cart be employed by CMI systems. Theories of 
instruction deal with the organization of instructional and testing options in order to optimize the 
effectiveness of the learning process. Such theories are indispensable for developing an effective CMI 
system and also for evaluating such a system." 

"Basic research must be expanded in learning theory, teaching theory, biochemical studies, and the 
sociology and anthropology of education." # 

", . .our efforts seem to be uniformly inadequate with respect to instructional technology. I have always 
been concerned that if and when the technical problems of CAI were resolved, we would still be unable * 
to use the capability effectively. I think we may very well have reached that stage with respect to CMI. 
That is, we may be approaching asymptote with respect to knowing how to build an adequate 
management system, but we are still grossly inadequate in knowing how to use that system effectively. 
The crux of the problem, as far as I am concerned, lies in our limited ability to detect relevant individual 
differences and to tailor instruction to those differences. While CMI can provide the management tool, it 
cannot provide the managern|nt rationale." 

"CMI does imply a change in the teaching and learning process in the classroom. Individualized 
instruction were key words throughout the Conference. However, our ability to change human behavior 
lags behind our technical capabilities. Much needs to be done with the training of people to accept and 
use the technology available now. I dare say most teachers-elementary, secondary, and university -are 
presently opposed to CAI and/or CMI projects." \ 

On Making CM I Cost-Effective in Education 

\ v 

The participants generally seemed to believe that a portion of the promise in CMI applications lay in the criterion 
of cost effectiveness. Three comments were representative: 
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"In times of tight money, which it looks like we may be in for some time to come, emphasis should be 
m glaced on ways to, do an equal job for less money. If computers are to be used to assist in cost 
reductions, then it jvould appear that CMI might show the way . My personal opinion is that we will find 
tha( the cheapest way to provide CMI, which in turn will help reduce overall educational costs, is 
through the use of mini-computers." 

"Direct attention should be given to efficient low-cost data transmission hardware. Hopefully, CMI . 
(whatever it is) can avoid the prohibitive cost of terminals and direct line hookups to computers." 

"Sponsor research to define and develop a family of low- to medium-cost computer terminals ir> support ^ 
of CML Much of the current research efforts appear to be aimed toward the use of such terminals as 
those represented by the PLATO IV project. Depending on the sophistication of CMI, much less 
expensive terminals would probably do the job. There needs to be research to define the functions of 
CMI and then to develop computer terminals to support these specific functions." 
♦ * * 

Summary . % » " 

The participants in this Conference are generally optimistic about the potential of CMI for impacting education 
and training. They were impressed with the wide variety of developed CMI systems discussed at the Conference. There was 
a general endorsement of the need for increased funding for research, and development in CMI and for greatej 
dissemination efforts, including frequent confidences. The participants make a persuasive case for the establishment of 
information and Course material clearing houses. They believe that setting up model CMI systems .would increase the 
acceptability of computer-based education as a viable alternative to traditional programs of instruction. * 
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"Thfc gag between 
computer-based 
potential and cur- 
rent practice in 
schools is gigantic. 
• . . a staggering 
total annuaPop- 
portunity of 22Vi ■ 
billion instruction 
hours exists/' 



The purpose of this papej: is to briefly review 
major applications of cdmputer technology in, 
schools and to examine the cpnstraints and incen- 
tives which will bear on their future Tole in basic 
education I will restrict my remarks" to computer 
applications in public and private lower schools. 

Major Uses of Computers in Schools * * 

There is no completely satisfactory way to 
classify^ knawn computer applications in schools 
because of the wide diversity of practice. There 
are, however, four major applications: (a) computer 
as an administrative aid; (b) computer as a scien- 
tific, arithmetic problem solver; (c) computer as an 
information retriever; and (d) computer as an in- 
struction facilitator. 

. Administrative Uses 

^Computers have their largest education appli- 
cation in administrative functions, preparation of 
payrolls, accounts receivable, accounts payable, and 
inventories. Teacher organizations favor the ad- 
ministrative use of the computer as a dues checkoff 
.device. 

Scientific Computing. 

The rapid growth of research and develop- 
ment activities in Colleges and universities has 
been made possible by a parallel growth in com- 
puter technology Scientific computing in higher* 
education, as differentiated from instruction to 
students in computing techniques, has been the 
principal education application of computers. 

Problem solving with computers, though Jess 
frequently applied in secondary schools "than in 
cojleges, is becoming increasingly important. 
Korotkin efaLj in a survey for the National 
Science, Foundation |NSF), learned that about 13 
percent of U.S. secondary schools had some type 
of computer cither on school grounds or available 
to staff and selected students through a remotg . 
terminal (1). 

Information Retrieval 

Not so well advanced is the use of the com- 



puter as an instantaneous 0 retrieval device. This 
application fQr separating one from many depends 
upon disk storage and time-sharing equipment 
which are commonplace in universities and large 
„ industries, out rare in schools. For the future, 
computer-based information retrieval looks prom- 
ising as schools try to improve their services. The 
SScmote Access Management System (RAMS), con- 
ceived and operated by the Oakland Intermediate 
Scfefc^ls in Michigan, illustrates such an applica- 
tion. 4 

Instruction Facilitation 

The fourth major application of computers 
is in facilitating instruction. Three subdivisions 
of this use are discussed below: drilband-practice; 
computer-managed instruction (CMI); and tutorial 
or computer-assisted instruction (CAI). The gap 
between computer-based potential and current 
practice in schools is gigantic. If there are approx- 
imately 50 million children in grades K-12 who 
spend an average of 5 hours per* day in school, 
then there are 250 million hours of scholastic 
t -effort per school day, of which perhaps half is 
adaptable and appropriate to either complete pupil/ 
computer interaction, or to some kind of com- 
puter supplement to regular lessons. With 125,- 
000,000 hours ^available per day during a typical 
school year of 180 days for some kind* of com- 
puter based interaction, a staggering total annual 
opportunity of. 22V ; 2 billion instruction hours 
exists. 

This opportunity can be met in a variety of 
ways. DrilUand-practice application^ 'are perhaps 
the best known. Jypically, the subject is mathe- 
matics or sortie other well-ordered material where 
each learner gets a 10-15 minute "shot^-pef-day-at- 
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carefully progmmm&Lrnaterial. Initial exposure of 
the pupil to the particular concepts. has jbeen ac- 
complished by traditional means. ^Irt this sense 
drill-and-practicc on-the computer is supplemental 
'to mainline instruction. t * 

In usinjpva ; computer -managed -instjuction 
(CMl) system the learner also acquires informa-** 
tion, skill and concepts in traditional ways. The 
computer is used for" testing, recording, and syn- 
thesizing a performance record for each learner. 
In primitive CMI systems the computer-generated 
information is used by a teacher to make individual 
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diagnoses* and prescriptions for learners. In ad- 
vanced systems, the learner uses the computer and 
receives his or her own diagnostic and prescriptive 
information. Fewer than a dozen CMI systems jn 
active us£ involve a few thousand students anrlL. 
ally. However; Because CMI systems are relatively 
inexpensive, their development seems assured. 

When most educators speak of comptttei-as- 
sisted instruction .(CAI), thty envision a tutorial 
application involving both the learner and the 
stored program in the computer. The Socratic 
model of one teacher and one learner has gener- 
ally been followed. A timesharing feature on 
many computers make* it possible for each of 
several learners to feel that he or she has the ex- 
clusive attention, of the device. The curriculum 
is offered in $uch a way that the student is ex- 
pected to reach the objectives of instruction at the 
computer terminal without outside study. Thus, 
in tutorial CAI the computer can be thought of as 
being integral to instruction, whereas in CMI and 
drill and practice modes the computer activity is 
supplemental.* 

Although computer technology has had con- 
siderable influence on American life, it has not 
yet had much impact on major instruction pro- 
grams in schools. If t\\c computer is to realize *its 
potential in schooling, what arc the conditions 
under which computer technology is the key to 
the future? 

Rationale 

Many protcchnology enthusiasts iTickton (2), 
Carnegie Commission (3), Committee for Economic 
Development^ |4), and Worth (5) J have assumed 
that the potential power of computers would be 
brought to bear on education. They have justified 
this position by assuming that because the com- 
puter has become indispensable to science, re- 
search, business, industry, banking, travel and 
dating bureaus, it will soon become, an indispens- 
able tool of instruction. This position fails to ac- 
count for constraints as Well as incentives for 
bringing computer technology to bear on the main- 
stream of schooling in this country. 

Although we have by no means considered 
<laU- factors, the subsequent discussion is organized 
aroTm^thc following topics: (a) expectations of 
schoojing/^ftt^lcinjmd for diversit y, (c) tow ard 
more humanjr school^Td 1 ) creation oFan education 
market for computers, (ef staffing the computer- 
based curriculum, and (f) paying the piper. 
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* The author has intentionally omitted the instructional 
applications in computer science and data processing 
courses in which the computer is employed as a tool 
to teach computer programming. 
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Expectations of Schooling 

"Many citizens arc dissatisfied with current 
results of schooling ISilbcrman (6)1. Employers, 
can't trust a high school diploma to be a literacy 
credential. Ghetto parents know that their chil- 
dren don't like school and are not acquiring basic 
skiljs. College professors arc appalled by the ab- 
sence of scholastic skills on the part oL-rt&w stu- 
dents. But despite these recurring and Valfd com- 
plaints about the results of schooling, our society 
still honors knowledge and employable skills, and 
the average citizen is sure that with a little tighten- 
ing up here and there, particularly on the part of 
teachers, the schools can turn out a satisfactory 
product. To suggest a massive infusion of new 
computer technology into a pervasive climate of so 
so satisfaction with schools is to court failure and 
frustration We as educators and moldcrs of public 
opinion must raise citizen expectations of ^heir 
schools Our| children arc capable of learning, 
achieving, and creating much more than our 
schools and homes arc currently affording. Sizcr 
offers an extensive discussion of this point (7). 
The logic and preprogrammed decision making 
capabilities of the modern digital computer make 
it the only candidate immediately in view that 
can handle the. complex task of monitoring, sum- 
marizing, diagnosing and prescribing instructional 
moves simultaneously for many learners. Of course, 
educators do not yet know which of the hundreds 
of descriptive variables about learners are most 
relevant for instruction. But this needed evidence 
represents an empirical question which can be 
derived from the experience of programming 
courses of instruction for computer presentation 
and trying them out on learners with many hy- 
potheses about different learner-adaptive variables. 

We have long recognized the motivating 
effects of "self direction or independent study. If 
instruction can be put into, computer storage, and 
learner^ given a wide variety of choices in de- 
ciding what they want to learn and in what se- 
quence, then education will be blessed* with in- 
creased motivation and improved learner self^ 
direction. These computer applications depend 
neither on new technological developments nor 
on new pedagogical concepts. The major restraints 
lie within the socjal institutions responsible for 
education, 

cmand for Dive rsity 

Toifler makes a persuasive case for the long- 
term trend of increasing diversity in life styles 
and" consumer products (8). In his view, the use of 
computers in schools offers the t opportunity to 
respond to increased citizen demand. for diversity. 

However, this demand for diversity is not 
being responded to adequately by most educators 



"We as educators 
and molders of 
public opinion 
must raise citizen 
expectations of 
their schools. Our 
children are ca- 
pable of learning, 
achieving, and 
creating much . 
more than our 
schools and homes 
are currently 
affording." 
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"If instruction can 
be put into com- 
puter storage, and 
learners given a 
wide variety of 
choices in decid- 
ing what they 
want to learn 
and in'what se- 
quence, then edu- 
cation will be 
blessed with in- 
creased motiva- 
tion and improved 
learner self-di- 
rection." 



ERIC 



in daily contact with children. The conflict thereby 
created will not be alleviated by ^adding more 
policemen to the school staff, nor by reducing 
average class size from 30 to 2S students. On the 
other hand, computer programs, which encourage 
inquiry, simulate real N world processes, and pro- 
vide for widely varying pupil interests do create 
a diverse environment for learning. 

The computer makes it possible for educators 
to greatly expand the available curriculum lor 
learners. The knowledge retrieval capability of 
large computer systems, plus the storage and use 
of adaptive information about learners will make it 
possible for every learner to have a unique cur 
riculum. k No longer will debates about curriculum 
be restricted to what can comfortably be taught to 
an average group of students at a particular grade 
level The computer makes^t possible for learners 
to have individual access to a wide variety of 
knowledge Instead of long debates about what is 
worth teaching, future educators will be able to 
shift this responsibility to the learner. 

Most people who remain ignorant of the es- 
sential openendedness of a computer system/ be- 
lieve that it is a device which impersonates and 
dehumanizcs'peoplc. But in actuality the computer, 
is capable of responding, when programmed jnppr' 
erly, to an almost infinite variety of patterns of 
behavior, physical characteristics, and tasies. Chil- 
dren who hav£ not been taught to fear technology, 
quickly grasp the diversity inherent in the com- 
puter and often become its devotees. 

* 

Toward More Humane Schools 

One root cause behind the common observa- 
tion that schools fail to educate lies in badly de- 
teriorated relationships between teachers and stu- 
dents. Thc^ crisis in teacher-student relationships 
is seen in school statistics on excessive absentee- 
ism, vandalism/ drug abuses riots, ' and Violent 
attacks on authority figures. School is perceived 
by students as. a spiritually destructive place which 
fills no essential need in their lives. Teachers arid 
administrators arc viewed as adults who "holler" 
at kids, enforce petty rules, and wield arbitrary 
power Ari adversary system dominates classroom 
interaction where the teacher, backed up By the 
principal and guidance counselor, is pitted against 
the students. While destructive interpersonal games 
are played out in some schools, society uneasily 
watches from the sidelines 

One of the "fi^t^thingS we must do to reform 
schools is to increase the expression of human 
warmth between adults and students. The chal 
lenge is how to change the' emotional climate of 
the classroom without sacrificing progress in the 
Achievement of academic goals Students Tnust be 
rcwarclpd for their honest" attempts to lcnrnS*To 




provide them with praise and other positive indi- 
cations of their self-worth, we must obtain more 
feedback than is characteristic of the classroom 
which provides a cage for 25*30 children, one 
teacher, and a variety of inert materials. Medley 
and Mitzel have shown that most* lessons above 
primary letfel are conducted cither us an expository 
lecture or a class discussion [9). Individual students 
have only minimal opportunities to interact' di- 
rectly with the teacher, who must somehow in- 
struct 30 students as if there were only 
\ In a previous article I have showri 
aggressive, able youngster in a traditior 
discussion can recite and receive feedback, \t 
ing praise, A, or 5 times during a 40-minutc class 
period (10). A shy, withdrawn child is easily over- 
looked and unnoticed and may recite with ex- 
pressions of teacher approval only once a week. 
Contrast that mass-education picture with the 
computer-assisted instruction workroom where 
every child receives fce/lback and encouragement 
of his or her learning .off orts once every 30 
seconds, on the average, for a total of 80 different 
rewarding and informative exchanges in a 40- 
minute period at the computer terminal. 

With sensitive programming, computer ter- 
minals can create an absorbing, responsive en- 
vironment for learning. The student knows that 
when he or she makes a response, something will 
happen immediately to provide him or her with 
an appraisal of the quality of the response and 
offer guidance toward future efforts. There is little 
wonder that 450' ninth graders in a4Jfcsburgh high 
school who spent a portion" of their daily mathe- 
matics lesson at the' computer terminal and a 
portion in individualized study with print media 
markedly prcfcrraTltne computer experience (11). 

So> far we have discussed the superiority of 
the computer terminal over conventional mass 
instruction in creating a responsive/ environment 
associated with typical learning activities. But there 
is an additional opportunity for greatly improving 
the quality of the school climate when computer 
tutorials arc introduced into schools. 

Tq understand this second opportunity we can 
classify^ classroom teacher skills ; as being of a 
higher or lower order. Examples of lower order 
skills arc: presentation of ^information to be 
learned, display of 'drill and practice exercises, 
evaluation of studcr^responscs, and provision of 
feedback. Examples of higher order skills arc: 
diagnosis of a student's learning disability, mediat- 
ing a dispute, assessing the impact of a student's 
home environment on behavior, and expressing 
comfort* for a wounded spirit or an inf&rcd body. 
The cause of instructional reform would be greatly 
advanced if lower order skills were handled Vy 
car^ully sequenced computer programs. Teachers 
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would -spend less time op lower- order skills and 
>vould transfer their uniquely human talents to the 
higher order skills forwhrch there is no computer 
( programming irr the foreseeable future. Many teach- 
/ ers wOuld have to be refrainccfrn order to shift their 
emphasis faua lower order skills' to higher' order ' 
ones.* . - v ' s> * 

Silberman documents the great interest .being 
expressed by^Ameriqan educators in the gritish 
, infajft, school model (K).. By foirfln^tfng structure " 
and- emphasizing isjudent .freedom to in<flirre and 
explore, those schools are unquestionably improv- 
/ ing schoolgoing attitudes on 'the part of students. 
Many Americans will, however, be unable to ac- 
cept the absence of the traditipnal lesson plan 
with its interest-arousal activities, presentation, ex- 
hortation and followup by flie teacher all* of 
* which "turn oft" most children in today's schools. 
Since tljc close .6f World '\Var II, Americans^ 
fcavc been trying to imprpvir their schools by in- 
creasing the subject matter knowledge of class- 
room teachers Fedcrall> sponsored instituted since 
the passage of the National Defense Education A*t 
fNOEAT^f 1958 have made -it possible for nyny 
teachers to increase their knowledge The rationale 
for this new, interest Jn'inservicc teacher education 
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to encourage* CALdcvclopcrs tcDtry to adapt busi- 
ness-oriented equipment* to the pedagogical needs 
of subject matter. -It's not working! Bank teller 
computer terminals and teletypes arc obvious mis- * 
fits in the world of pedagogy.* Some developers % 
have been willing to make compromises with the 
real. world in order to try to use such, equipment 
for teaching purposes. Others have opted for the 
lean or business terminal on the grounds of 
cc&nomy'. 

An attempt to adapt computers, to CAI needs 
was made by the International Business Machines 
(IBMJ Corporation in 19(37. At that time IBM dc- # 
vclopcd a social limited version of aninstructional* 
system, the IBJvl 1500. Only 25 units were assem- 
bled ajid marketed. The majority of these arc still 
operating in university research and development^ 
laboratories. More recently, under sponsorship from 
the National Science Foundation, the PLATO proj- 
ect at the University of Illinois (l5}-and the TICCET 
project at the Mitre Curporation*(14) arc attempting 
to fill the void in computer terminals designed tor 
instruction as part of complete new systems.* 

It is, however, unfair to place all of the blame 
for turtle paced progrfss in CAI application on ■ 
the hardware community. Schools must recognize 



was the notion <h^a 'teacher cannot 'teach that there is a long-term dcvcfopmcntal 'process 

those stihiects which.hc o* she does not know well. involved in applftng computer technology to in- 

It seems to me that, the heavy emphasis on struction. Schools can create the beginnings, ot a 

student acquisition of hard content, characteristic mass market* for manufacturers by investing in 

or die postsputnik era, has been, bought at tly^ some earjj design equipment ft should be under* 

prid- of a declining interest and concern among^, stood that pioneenng equipment has to be tried 
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educators "for the jtjiman values which* should be 
a part of schooling. If we shifte'd a major portion 
of the lower order presentation skills to a ric^ 
CAI envirctnmcnt^nd then retrained our. teachers 
to engage in and emphasize tfighef order, human 
relations skifis in the classrooJrr^weL could reform 
the education, of many Amcijcans. Jfara'doxically, 
computed, the ^epitome of injgraonality^ arid 
product of the space age, offer us an opportunity 
to reform, our ^ schools* by making it possible^ 
"redirect efforts and humanize schooling. 

Creation of an fyfycatioinMarket for Computers " * 

/ 0nc reason for the slow assimilation of co'n> 
putcr technology" into the instructional heart of 
education -is the unavailability of hardware and 
operating systems specifically designed for instruc- 
tion Computer manufacturers have been 'unable 
to recognize an unambiguous mass market for 



.w . — .... "><ai>i)'i A uv Ui > i.id^ utjiiRd ioi - putcr applications in schools Our planning .should 

education machines Instcad^he partem has been/ target the urates for achievement of specific inter 



pioneering equipment has to be tried 
out jn'thc field so that resign ancfimprovemcnt 
can occur. The schools should also be aware {hat 
the existence of a mass market ultimately brings 
down .tiic ^cosfc 0|f| technological products. 

© Of all the constraints operating to prevent 
optimum application of computers in schools* none 
seems more dismal than the "waiting game.." Man- 
ufacturers arc waiting for a mass market to appear 
for CAI cquipmcrit. Schools arc timidly -^waiting 
for 21st century sophistication to -appear in CAT 
systems before inventing. a nickel. Curriculum de- 
velopers, instructional tcchnofogfetsr the federal 
..government, and others -ni the middleware waiting 
for both sides to. move? Vyp'bclicvc tthl a break 
in this crisis oMcadcrj^ip''wilL come, with federal 
initiatives toward long-range planning. The same 
•type of effort now fcciq^; applied (o the- energy 
/-runch would also well scrvc % thc needs of com* 
putpr^ariplicatiqns in schools Our planning should 
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_*Wc arc^ot necessarily rccomracHding the use of the 
computer in this massive retraining effort,, .but it 
* shoiilcl be noted that CAI^a^bccn used cffcctivcl^for 
Jristrvicc teacher education "at Pcnn State since 1971. 
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• PLATO is an a,cro)nyrrf for Programmed Logic for 
Automatic. Teaching Operations, TICCET. is an acro- 
nym" for Time-SharcA Interactive Computer-Controlled 
Educational Television, t * ' 
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programming, 
computer termi- 
nals can create an 
absorbing, respon 
sive jenvirdnmefit 
for learning." 

"One reason for . 
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tion of computer 
technology into 
the instructional 
heart of education 
is the unavailabil- 
ity of hardware ^ 
and operating sys- 
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designed for in- 
struction/' 
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"A miliUnt stance 
by teacher organi- 
zations on the job 
preservation issue 
as the price for 
admitting new 
technology wouH 
nof bode well for 
the future of the 
schools." 
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mediate goals with realistic schedules for research 
and develophient activities. 

Staffing the Computer-Based Curriculum. . 

Sizer sets the tone for a discussion of con- 
straints 011 CAI provided by working educators in 
the schools: 

The possibility that 1 computers will be used in 
schools seems to turn otherwise reasonable; men 
and women into either , implacable Luddites or 
idealistic zealots. To some the machine is the 
symbol of inhumanity t a blinking ngid monster 
devoted to the dehumanization of the school. To 
others the computer is the route to new pedagogi 
cal sophistications, a device to free thechild irom 
the clutches of the biased, smotWSi^ teacher 
Luddjtcs think of zealots as blooSu&s tcchni- 
cfanjt. The latter find the former fearful reaction** 
ari«. Botli s iuddite$' and zealots' aro 'wrong, .of 
Sursc, and both are perversely ngfrr . . . a new 
/feroup of educators, who are neither Luddites nor 
zealots, needs to be formed, and serious inquiry on 
the purposes* of computer technology in reaching 
them must be pressed (15}. 

Although the widespread use of .computers in 
schools might not^ change the overall staffing needs 
in the knowledge industry, ^&Sfc would undoubt 
cdjy be major 'shifts in the pattern c^pjobs and in 
the training required for their execution. CAI in 
schools ^Vould likely create a differentiated staffing 
pattern where there would be fcweKworkcrs in the 
middle salary bracket of $10,000 15/XJ0 annually. 
Presumably, there would be more appoyKments of 
paraprofcssionals (at S^CXX) 7,500) and high^eyel 
specialists (at $20,000 25,000). Assuming a rcfoi 
of education based on the benefits of the new 
technology, there would be a ^rr^cp 
thc^icccssity fcSr spccia Hsts >uclTas^rcmedial read 
ing teachers, guibUncc coynsclors, special cduca 
tion teachers, and resource room teachers. On the 
other hajid, the numbfer of curriculum designers,, 
instructional tcchnologists\and audio visual illus 
trators should markedly Mncr 

The goal for thfc zealots to vTrneh Sizer refers 
above is to.be able fo^ to ^v incc tne politically* 
sensitive leaders of teacher organizations that the 
long^erm interests of their members arc better 
served by qualifying for better paying higher* level, 
more * technically and man&gctially \involvcd po 
sitions than is presently the casc.^ miktant stance, 
by teacher organizations oe the jbb preservation 
issue as the price for adrr#ting new technology 
would not bode well for the future o^jfthc. schools. 
Society .would undoubtedly bfcfein to look, else 
where for new educative mechanisms. * 1 

Paying the Pfjer * % a 

A major constrain! ko sizeable computer ap- . 
plication an instruction i^^c current budgeting 

.i . * . • • -» ■ 



practice.. School systems, characteristically allocate 
80-90 percent of their operating budgets to per- 
sonnel costs associated with instruction. jAfter 
taking out costs such as debt reduction and physi- 
cal plant maintenance, there are practically <po 
degrees of freedom. Rising personnel costs must 
be met with an increase in the total . operating . 
budget. Most laymen can only conceive of the 
purchase of instructional equipment as an item 
in the operating .budget. Obviously, the.purchase 
of a million-dollar computer for a school organi- 
zation'with a $15,000,000 annual operating budget 
is 8.5 percent of the $12,p00,000 already com 
mittcd to teaching personnel on a continuous 
basis, fcvcfn if the same pupil services . could be 
shown to be provided by the computer, the social 
and political pressure generated by a release of 10 
"percent of the teaching faculty would be fierce. 

One way to make a nontrivial implication of. 
computer technology in, schools is to think of a 
computer as a long term capital investment in a 
teaching tool. In a sense school buildings are 
teaching, tools and they are characteristically 
amortized over a period of 30-50 years. . 

No one has thought much about amortization! 
of computers because they have characteristically 
had a high obsolescence rate as successive genera- 
tions of faster and more powerful machines have 
been made available by manufacturers. Because 
third and fourth generation computers depend on 
miniaturized components, it is safe to conclude 
that the useful life of the devices has been greatly 
extended. With proper maintenance, it. would not 
seem to be an undue risk to estimate that an in- 
structional computer would serve a typical schpol 
JoM 5 20 years. Spreading acquisition and benefits 



jver a relatively long term drastically reduces the 
impact of a>cprnputcr application to instruction on 
the anrYual one rating budget of a school. Such a 
plan hclpstb^cdrcss thc^Hlbalancc of^xecssive 
labor intensity in SLhoolCfinancing by Atcasing 
dependence on a capital mvesffftcnt. " 

Purchased cornputcrs applied to instructional 

- tasks have another financial s^d vantage. The long 
term projection for pcrsonncTNsalaries is on a 

. rapidly rising curve. The ujfltrcratury spiral is 
almost guaranteed to majrc wages for^ieachers a* 
major bargaining poinj^octween school authorities 
and teacher organifations. This, means that into 
dollars will have to- come from tax sources to meet" 

* escalating* demands. On the other hand, interest 
rates paid on bonded" indebtedness for equipment 
acquisitions is. steady. In the long run, a school 

/can save money if its operations arc* somewhat less 
labor intensive and its' budget* less <■ sub jeet .to in* 
crca$cs duc S to inflation. 

* Other large cost itcriis^ associated with the 
adoption , of computers in instruction arc con 
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ccrned with the development and maintenance of 
curriculum. Variability exists in costs of computer 
programs designed and tested for different uses in 
schools. For example, drill-and-practice programs 
in arithmetic can be produced inexpensively be- 
cause the computer generates its own numerical 
values from 'a simple set of instructions. Frame- 
oriented tutorial programs, however, are costly 
because the author/programmer must anticipate 
a wide variety of learner responses and instruct 
the computer to m^e •appropriate feedback. High 
quality, tutorial material, based on our experience 
at Penn State University's (?AI Laboratory, costs 
between $5,000-$ 10,000 j)er average learner* tlock 
hour Thus, at midrange prices, a 30 clock hour 
course costs 'approximately $225,000 to build. 
There does not seem to be enough accumulated 
experience to forecast the development "costs for 
computer-based games, simulations, and extended 
inquiry. 

Education i£*so Decentralized that it seems 
unlikely tha.t individual school organizations will 
be able to afford the development of their own 
computer-based curriculum. Statewide or regional 
consortia seem to be the best^bet for actually put- 
ting programs together. £ven i( stated or regions 
can jnount the necessary curriculum initiative, it 
.uwill probably be up to the federal government to 
provide the financial resources for massive pro- 
gram development. Solutions will have to be 
found to the problem of inctfmpatible computer 
systems, and to the problem of how schools can 
• inexpensively make minor change^ in programmed 
.materials. 
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